-- Logs begin at Mon 2022-06-20 05:08:22 UTC, end at Mon 2022-06-20 06:22:19 UTC. -- Jun 20 05:53:17.248118 dv-cinder-836996-36-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 20 05:53:17.258174 dv-cinder-836996-36-smb devstack@keystone.service[80104]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 20 05:53:17.260719 dv-cinder-836996-36-smb devstack@keystone.service[80104]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 05:53:17 2022] *** Jun 20 05:53:17.260719 dv-cinder-836996-36-smb devstack@keystone.service[80104]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 05:53:17.260719 dv-cinder-836996-36-smb devstack@keystone.service[80104]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 05:53:17.260719 dv-cinder-836996-36-smb devstack@keystone.service[80104]: nodename: dv-cinder-836996-36-smb Jun 20 05:53:17.260719 dv-cinder-836996-36-smb devstack@keystone.service[80104]: machine: x86_64 Jun 20 05:53:17.260719 dv-cinder-836996-36-smb devstack@keystone.service[80104]: clock source: unix Jun 20 05:53:17.260719 dv-cinder-836996-36-smb devstack@keystone.service[80104]: pcre jit disabled Jun 20 05:53:17.260719 dv-cinder-836996-36-smb devstack@keystone.service[80104]: detected number of CPU cores: 4 Jun 20 05:53:17.260719 dv-cinder-836996-36-smb devstack@keystone.service[80104]: current working directory: / Jun 20 05:53:17.260719 dv-cinder-836996-36-smb devstack@keystone.service[80104]: detected binary path: /usr/bin/uwsgi-core Jun 20 05:53:17.261372 dv-cinder-836996-36-smb devstack@keystone.service[80104]: your processes number limit is 47680 Jun 20 05:53:17.261372 dv-cinder-836996-36-smb devstack@keystone.service[80104]: your memory page size is 4096 bytes Jun 20 05:53:17.261372 dv-cinder-836996-36-smb devstack@keystone.service[80104]: detected max file descriptor number: 2048 Jun 20 05:53:17.261372 dv-cinder-836996-36-smb devstack@keystone.service[80104]: lock engine: pthread robust mutexes Jun 20 05:53:17.261372 dv-cinder-836996-36-smb devstack@keystone.service[80104]: thunder lock: enabled Jun 20 05:53:17.261372 dv-cinder-836996-36-smb devstack@keystone.service[80104]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 20 05:53:17.261372 dv-cinder-836996-36-smb devstack@keystone.service[80104]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 05:53:17.304080 dv-cinder-836996-36-smb devstack@keystone.service[80104]: Python main interpreter initialized at 0x5647be3c09c0 Jun 20 05:53:17.304080 dv-cinder-836996-36-smb devstack@keystone.service[80104]: python threads support enabled Jun 20 05:53:17.304080 dv-cinder-836996-36-smb devstack@keystone.service[80104]: your server socket listen backlog is limited to 100 connections Jun 20 05:53:17.304080 dv-cinder-836996-36-smb devstack@keystone.service[80104]: your mercy for graceful operations on workers is 90 seconds Jun 20 05:53:17.304435 dv-cinder-836996-36-smb devstack@keystone.service[80104]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 05:53:17.304511 dv-cinder-836996-36-smb devstack@keystone.service[80104]: *** Operational MODE: preforking *** Jun 20 05:53:17.304774 dv-cinder-836996-36-smb devstack@keystone.service[80104]: *** uWSGI is running in multiple interpreter mode *** Jun 20 05:53:17.304774 dv-cinder-836996-36-smb devstack@keystone.service[80104]: spawned uWSGI master process (pid: 80104) Jun 20 05:53:17.304966 dv-cinder-836996-36-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 20 05:53:17.306341 dv-cinder-836996-36-smb devstack@keystone.service[80104]: spawned uWSGI worker 1 (pid: 80115, cores: 1) Jun 20 05:53:17.306341 dv-cinder-836996-36-smb devstack@keystone.service[80104]: spawned uWSGI worker 2 (pid: 80116, cores: 1) Jun 20 05:53:17.306341 dv-cinder-836996-36-smb devstack@keystone.service[80104]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 05:53:22.680374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:53:22.680374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: from cryptography.utils import int_from_bytes Jun 20 05:53:22.681159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:53:22.681159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: from cryptography.utils import int_from_bytes Jun 20 05:53:22.681287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:53:22.681287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: from cryptography.utils import int_from_bytes Jun 20 05:53:22.681287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 05:53:22.681287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: from cryptography.utils import int_from_bytes Jun 20 05:53:22.729598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 05:53:22.729798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 05:53:22.729964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] command line args: [] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 05:53:22.730241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 05:53:22.730418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ================================================================================ {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 05:53:22.730506 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 05:53:22.730671 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] admin_token = **** {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.730752 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 05:53:22.730877 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] command line args: [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 05:53:22.730962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] config_dir = [] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.731091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.731170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 05:53:22.731272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] config_source = [] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.731357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ================================================================================ {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 05:53:22.731436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] debug = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.731557 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] admin_token = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.731641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.731944 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] config_dir = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.732048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.732145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.732247 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] config_source = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.732391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.732503 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] debug = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.732602 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.732698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.732828 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.732927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.733034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] list_limit = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.733139 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.733242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] log_config_append = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.733344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.733448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.733448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] log_dir = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.733675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.733817 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] log_file = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.733982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.733982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_config_append = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.734225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.734339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.734485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.734569 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_dir = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.734642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.734709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_file = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.734779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.734906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.734994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.735076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.735154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.735274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.735356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.735435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.735564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.735652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.735731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.735803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.735921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.736007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.736088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.736161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.736562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.736648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.736766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.736855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.736936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.737008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.737130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.737212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.737334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.737579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.737665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.737774 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] publish_errors = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.737852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.738005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.738233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.738319 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.738394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.738522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] publish_errors = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.738641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.738727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.738872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.738950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.739073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.739159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] standard_threads = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.739322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.739401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.739560 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.739645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.739768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.739849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] standard_threads = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.739921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] use_journal = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.740002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.740074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] use_json = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.740219 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] use_stderr = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.740306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.740415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] use_syslog = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.740490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.740583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] use_journal = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.740661 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.740742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] use_json = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.740874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.740960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] use_stderr = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.741077 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] use_syslog = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.741154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.741305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 05:53:22.741397 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.741560 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.741639 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.741796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.741881 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.742038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.742128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.742278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.742355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.742510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.742594 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.742750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.742836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.742995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.743073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.743226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.743304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.743463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.743549 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.743706 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.743821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.743937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.744011 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.744192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.744290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.744994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.745080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.745231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.745319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.745479 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.745638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.745715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.745793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.745951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.746037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.746185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.746274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.746438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.746517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.746678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.746755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.746912 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.747002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.747163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.747242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.747392 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.747469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.747622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.747709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.747851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.747931 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.748085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.748163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.748342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.748436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.748575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.748654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.748808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.748887 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.749035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.749114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.749281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.749359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.749510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.749587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.749739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.749827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.749984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.750068 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.750218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.750296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.750452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.750536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.750684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.750761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.750913 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.750997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.751148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.751224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.751359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.751437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.751583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.751660 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.751810 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.751890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.752037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.752115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.752263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.752355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.752519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.752600 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.752747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.752824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.752981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.753070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.753213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.753292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.753440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.753518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.753671 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.753749 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.753902 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.753981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.754280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.754405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.754405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.754637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.754747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.754847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.754945 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.755048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.755146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.755250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.755340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.755416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.755535 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.755611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.755721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.755793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.755926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.756016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.756158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.756294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.756457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.756537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.756656 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.756746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.756872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.756952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.757102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.757180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.757331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.757411 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.757567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.757651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.757799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.757920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.758054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.758174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.758287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.758368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.758520 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.758598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.758754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.758849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.758988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.759112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.759205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.759325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.759442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.759530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.759680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.759759 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.759940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.760018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.760176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.760267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.760439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.760527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.760673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.760752 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.760905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.760992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.761138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.761218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.761370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.761449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.761603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.761692 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.761838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.761922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.762079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.762164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.762314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.762468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.762545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.762621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.762768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.762849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.762998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.763085 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.763228 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.763319 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.763456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.763535 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.763683 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.763761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.763910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.763996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.764136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.764215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.764390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.764476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.764618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.764710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.764854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.764936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.765086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.765169 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.765331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.765419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.765566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.765646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.765795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] auth.external = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.765879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.766027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.766117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.766293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.766372 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.766522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.external = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.766602 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.766752 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.766842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] auth.password = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.766979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] auth.token = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.767066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.767218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.767298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.767453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.767538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.password = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.767696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] auth.token = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.767776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.767926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.768006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.768157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.768236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.768425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.768507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.768655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.768745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.768888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] credential.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.768967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.769132 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.769212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.769362 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.769442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.769599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.769680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.769833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.769919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.770079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.770159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.770313 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.770395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.770547 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.770628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.770791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.770871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.771024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.771103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.771282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.771363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.771533 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.771612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.771768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.771857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.772020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.772102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.772280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.772378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.772552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.772641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.772796 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] federation.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.772884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.773036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.773117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.773282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.773362 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.773514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.773594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.773744 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.773823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.773988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.774066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.774220 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.774300 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.774449 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.774527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.774694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.774773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.774928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.775014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.775170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.775249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.776191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.776368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.776465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.776542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.776674 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.776755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.776920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.777000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.777150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.777228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.777377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.777459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.777624 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.777713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.777854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.777941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.778090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.778170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.778339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.778428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.778568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.778647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.778805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.778885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.779033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.779121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.779263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.779346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.779504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.779585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.779731 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.779819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.779961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.780042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.780207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.780287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.780475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.780567 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.780721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.780803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.780974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.781054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.781207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.781295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.781437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.781517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.781670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.781750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.781898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.781986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.782130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.782210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.782361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.782440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.782595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.782692 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.782821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.782902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.783050 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.783128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.783282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.783369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.783526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.783604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.783751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.783829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.783993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.784081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.784236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.784360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.784485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.784575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.784722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.784814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.784950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.785030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.785177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.785256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.785409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.785497 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.785635 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.785714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.785869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.785949 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.786102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.786192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.786342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.786423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.786577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.786659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.786808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.786896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.787040 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.787120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.787288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.787367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.787519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.787608 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.787746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.787827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.787979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.788058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.788213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.788302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.788472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.788553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.788704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.788782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.788936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.789030 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.789165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.789246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.789401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.789482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.789644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.789725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.789872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.789952 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.790110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.790190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.790338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.790419 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.790576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.790656 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.790806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.790885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.791082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.791679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.791822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.791903 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.792055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.792134 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.792289 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.792418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.792539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.792619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.792785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.792865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.793030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.793112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.793256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.793335 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.793502 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.793582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.793737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.793818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.793963 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.794049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.794197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.794276 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.794429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.794509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.794662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.794742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.794894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.794974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.795125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.795207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.795366 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.795447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.795595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.795675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.795837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.796071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.796150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.796304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.796402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.796564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.796657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.796810 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.796891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.797044 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.797123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.797272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.797360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.797506 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.797585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.797743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] resource.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.797828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.797979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.798071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.798209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.798289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.798446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.798525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.798682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.798769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.798929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.799010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.799164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.799242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.799401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.799489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.799637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.799717 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.799875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.799960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.800110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.800264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] role.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.800388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] role.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.800464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.800600 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.800681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.800836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.800928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.801069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] role.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.801150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.801314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] role.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.801394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.801544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.801633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.801787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.801868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.802032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.802111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.802277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.802357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.802522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.802601 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.802752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.802832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.802997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.803076 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.803239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.803319 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.803482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.803561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.803713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.803794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.803957 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.804105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.804204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.804363 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.804459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.804619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.804700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.804869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.805089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.805170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.805327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.805409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.805574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.805653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.805820 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.805898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.806066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.806148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.806304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.806382 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.806536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.806636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.806788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.806869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.807019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.807099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.807270 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.807350 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.807498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.807579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.807726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.807806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.807954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.808042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.808203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.808281 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.808458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.808538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.808695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] token.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.808787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.808932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.809011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.809168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.809247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.809397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.809493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.809631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.809711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.809866 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.809946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.810101 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.810206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.810340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.810420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.810583 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.810662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.810826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.810914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.811059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.811138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.811294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.811374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.811533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.811621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.811779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.811858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.812013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.812093 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.812240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.812346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.812494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.812575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.812740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.812820 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.812986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.813079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.connection = **** {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.813214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.813307 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.813452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.813533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.813722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.813800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.813961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.814049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.connection = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.814193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.814283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.814427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.814507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.814659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.814739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.814892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.814974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.815123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.815203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.815355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.815434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.815587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.815668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.815816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.815895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.816054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.816132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.816286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.816419 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.816548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.816627 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.816776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.816854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.817013 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.817095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.817245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.817324 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.817398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80115) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 05:53:22.817470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.817704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.817939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.818170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 05:53:22.818338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80116) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 05:53:22.847842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:22.848069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:22.848303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:22.849070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:22.849301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:22.849526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:22.857376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:22.858573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:22.884863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:22.885089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:22.886261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:22.886490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.026782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.027091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.075373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.075605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.076099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.076349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.139186 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.139411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.139503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.139631 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.139734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.139851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.139937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.140066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.140149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.140280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.140398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.140518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.164878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.165113 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.165253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.165363 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.165489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.165574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.165711 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.165795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.165932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.166504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.166671 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.166754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.166885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.167097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.177598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.177872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.190096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.190325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.190549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.190650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.190770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.190855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.190987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.191071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.191200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.191285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.191411 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80115) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.191494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.191643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.191855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80116) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 05:53:23.208991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.209197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:53:23.209532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.209731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:53:23.209820 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.209955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:53:23.210039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.210243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.210326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.210463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 05:53:23.210554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.210726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.210808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.210982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.211234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.211486 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.221503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.221776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.222041 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.222279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.222364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.222551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.222816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.223092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.231075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.231844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.234822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.234822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.234979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.235119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.235201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.235403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.235498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.235665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.235763 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.236044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.236152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.236353 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.236450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.236608 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.236689 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.236879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.236984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.237141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.237231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.237440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.237709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.237973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.264208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.264671 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.265829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.266111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.266279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.266551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.271308 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.271695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.271785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.271975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.272158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.272464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.279542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.279775 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.279956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.280233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.284291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.284644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.284735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.284926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.285031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.285203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.285294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.285472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.285562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.285740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.285840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.286007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.286097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.286276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.286366 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.286539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.305188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.305463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.306364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.306691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.310626 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.311867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.314249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.314648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.315492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.315885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.319629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.320891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.323249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.324505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.326904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.327200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.327481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.327755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.328025 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.328116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.328297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.328408 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.328682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.328961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.329237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.329515 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.347155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.347432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.347693 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.347960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.348385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.348673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.348937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.349202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.356344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.357586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.358044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.358319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.359285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.359558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.361556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.361850 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.362146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.362476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.362732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.362832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.363004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.363275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.363574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.363879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.375866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.376144 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.376555 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.376857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.377114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.377388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.377674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.377946 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.378418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.378706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.378996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.379519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.379811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.380098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.397172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.398323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.400501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.402238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.404040 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.405543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.405766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.407243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.407397 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.407680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.407957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.408941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.409222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.409496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.415578 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.417296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.417861 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.419000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.421096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.421384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.421769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.422047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.422208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.422495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.422884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.423159 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.431021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.431302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.431576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.432754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.433032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.433305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.439911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80115) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.440185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.440485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.440753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.441019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.441146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80116) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 05:53:23.441379 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.441506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.441643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.441770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.441915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.442043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.442169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.442304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.442431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.442556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.442692 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.442873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.443002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.443129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.443267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.443393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.443528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80115) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.443655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.443782 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.444032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.444327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.444593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80116) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 05:53:23.481351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647be3c09c0 pid: 80115 (default app) Jun 20 05:53:23.484504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647be3c09c0 pid: 80116 (default app) Jun 20 05:53:23.484772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd60a-79b0-4f29-8b17-bba1f19eb0d3 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:23.485065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd60a-79b0-4f29-8b17-bba1f19eb0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:23.485342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acd60a-79b0-4f29-8b17-bba1f19eb0d3 None None] PATH_INFO: `/v3` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:23.489559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Mon Jun 20 05:53:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:31.210443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e3df1-7c9b-4680-b3fc-408dd625697b None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:31.211020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e3df1-7c9b-4680-b3fc-408dd625697b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:31.211020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e3df1-7c9b-4680-b3fc-408dd625697b None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:31.215809 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:31.221319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0b94-4ee3-442b-9eb7-021f907e31f3 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:31.221754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0b94-4ee3-442b-9eb7-021f907e31f3 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:31.221899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d0b94-4ee3-442b-9eb7-021f907e31f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:31.292703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: INFO dbcounter [None req-633d0b94-4ee3-442b-9eb7-021f907e31f3 None None] Registered counter for database keystone Jun 20 05:53:31.314175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG oslo_db.sqlalchemy.engines [None req-633d0b94-4ee3-442b-9eb7-021f907e31f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80115) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:53:31.320402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writer thread running {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:53:31.497526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG passlib.handlers.bcrypt [None req-633d0b94-4ee3-442b-9eb7-021f907e31f3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80115) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 05:53:31.497871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG passlib.handlers.bcrypt [None req-633d0b94-4ee3-442b-9eb7-021f907e31f3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80115) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 05:53:31.552083 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-633d0b94-4ee3-442b-9eb7-021f907e31f3 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:31.553723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-633d0b94-4ee3-442b-9eb7-021f907e31f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:31.674170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 20 05:53:31.851832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e3df1-7c9b-4680-b3fc-408dd625697b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:31.921275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: INFO dbcounter [None req-609e3df1-7c9b-4680-b3fc-408dd625697b None None] Registered counter for database keystone Jun 20 05:53:31.940499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG oslo_db.sqlalchemy.engines [None req-609e3df1-7c9b-4680-b3fc-408dd625697b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80116) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 05:53:31.946589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writer thread running {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 05:53:32.065021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e3df1-7c9b-4680-b3fc-408dd625697b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:32.069227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480c4e2-1f52-4f60-883b-793b2c671d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:32.069884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c4e2-1f52-4f60-883b-793b2c671d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:32.070165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c4e2-1f52-4f60-883b-793b2c671d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:32.070439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480c4e2-1f52-4f60-883b-793b2c671d6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:32.078494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480c4e2-1f52-4f60-883b-793b2c671d6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:32.130819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2480c4e2-1f52-4f60-883b-793b2c671d6e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 05:53:32.131163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480c4e2-1f52-4f60-883b-793b2c671d6e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:32.140551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jun 20 05:53:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 05:53:32.146506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d0b94-4ee3-442b-9eb7-021f907e31f3 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:32.161141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d0b94-4ee3-442b-9eb7-021f907e31f3 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:32.165542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfbf1e-3710-4036-adb2-3500479090a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:32.167187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfbf1e-3710-4036-adb2-3500479090a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:32.167478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfbf1e-3710-4036-adb2-3500479090a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:32.167755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfbf1e-3710-4036-adb2-3500479090a5 admin admin] PATH_INFO: `/v3/projects/0a570b43b29a48ed93337d06e7d2c924` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:32.171861 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfbf1e-3710-4036-adb2-3500479090a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=0a570b43b29a48ed93337d06e7d2c924)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:32.222803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c5bfbf1e-3710-4036-adb2-3500479090a5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 05:53:32.223340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfbf1e-3710-4036-adb2-3500479090a5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:32.227714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jun 20 05:53:32 2022] GET /identity/v3/projects/0a570b43b29a48ed93337d06e7d2c924 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:34.202645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7d71f-a645-459b-8a2f-ff74c2ed2d09 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:34.203178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7d71f-a645-459b-8a2f-ff74c2ed2d09 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:34.203178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7d71f-a645-459b-8a2f-ff74c2ed2d09 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:34.207312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:34.212669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825b1b1-90d0-4a1c-942c-62c2332daa13 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:34.213058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825b1b1-90d0-4a1c-942c-62c2332daa13 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:34.213243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825b1b1-90d0-4a1c-942c-62c2332daa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:34.231728 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b825b1b1-90d0-4a1c-942c-62c2332daa13 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:34.233303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b825b1b1-90d0-4a1c-942c-62c2332daa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:34.241263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 20 05:53:34.264456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7d71f-a645-459b-8a2f-ff74c2ed2d09 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:34.276886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7d71f-a645-459b-8a2f-ff74c2ed2d09 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:34.281117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad93ece-5f62-467b-8381-df47ae5fb7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:34.281751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad93ece-5f62-467b-8381-df47ae5fb7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:34.282038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad93ece-5f62-467b-8381-df47ae5fb7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:34.282317 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad93ece-5f62-467b-8381-df47ae5fb7e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:34.290023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad93ece-5f62-467b-8381-df47ae5fb7e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:34.291875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad93ece-5f62-467b-8381-df47ae5fb7e4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:34.300646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jun 20 05:53:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 05:53:34.305940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825b1b1-90d0-4a1c-942c-62c2332daa13 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:34.315725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825b1b1-90d0-4a1c-942c-62c2332daa13 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:34.319989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e3ad1-4668-470f-9dd3-48e1d4bc0caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:34.320892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e3ad1-4668-470f-9dd3-48e1d4bc0caf admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:34.321184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e3ad1-4668-470f-9dd3-48e1d4bc0caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:34.321460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e3ad1-4668-470f-9dd3-48e1d4bc0caf admin admin] PATH_INFO: `/v3/users/97288f3cd6034b58b6dbfbe8f64b9614` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:34.323390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e3ad1-4668-470f-9dd3-48e1d4bc0caf admin admin] RBAC: Authorizing `identity:get_user(user_id=97288f3cd6034b58b6dbfbe8f64b9614)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:34.325253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e3ad1-4668-470f-9dd3-48e1d4bc0caf admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:34.326813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jun 20 05:53:34 2022] GET /identity/v3/users/97288f3cd6034b58b6dbfbe8f64b9614 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:36.390438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064958-9dce-4487-b764-f9ac3e9cd4ed None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:36.390969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064958-9dce-4487-b764-f9ac3e9cd4ed None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:36.391059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064958-9dce-4487-b764-f9ac3e9cd4ed None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:36.391476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1579efa-9795-46ca-98a9-5b67c9b70599 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:36.391854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1579efa-9795-46ca-98a9-5b67c9b70599 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:36.392041 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1579efa-9795-46ca-98a9-5b67c9b70599 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:36.392384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:36.393441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:53:36.397044 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a419f78-c712-4f06-8e44-c5e84fdc4150 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:36.397337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a419f78-c712-4f06-8e44-c5e84fdc4150 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:36.397617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a419f78-c712-4f06-8e44-c5e84fdc4150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:36.399095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddc65c-494b-4db3-9af6-252744ac691c None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:36.399523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddc65c-494b-4db3-9af6-252744ac691c None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:36.399916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddc65c-494b-4db3-9af6-252744ac691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:36.416766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-55ddc65c-494b-4db3-9af6-252744ac691c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:36.417981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-55ddc65c-494b-4db3-9af6-252744ac691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:36.437344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG passlib.handlers.bcrypt [None req-8a419f78-c712-4f06-8e44-c5e84fdc4150 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80116) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 05:53:36.437763 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG passlib.handlers.bcrypt [None req-8a419f78-c712-4f06-8e44-c5e84fdc4150 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80116) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 05:53:36.483081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8a419f78-c712-4f06-8e44-c5e84fdc4150 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:36.484734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8a419f78-c712-4f06-8e44-c5e84fdc4150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:36.497986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 7/12] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:53:36.520217 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddc65c-494b-4db3-9af6-252744ac691c None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:36.543260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:36.584599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 6/13] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:36.607397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a419f78-c712-4f06-8e44-c5e84fdc4150 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:36.622773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddc65c-494b-4db3-9af6-252744ac691c None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:36.655485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a119dd1-3b9f-44da-9683-cd5f166fa55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:36.656137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a119dd1-3b9f-44da-9683-cd5f166fa55d None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:36.656455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a119dd1-3b9f-44da-9683-cd5f166fa55d None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:36.656736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a119dd1-3b9f-44da-9683-cd5f166fa55d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:36.705741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a419f78-c712-4f06-8e44-c5e84fdc4150 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:36.707987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:36.721641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a119dd1-3b9f-44da-9683-cd5f166fa55d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:36.723157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a119dd1-3b9f-44da-9683-cd5f166fa55d None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:36.744736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d8d4c-129a-4754-8f0e-cb8541503566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:36.745698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8d4c-129a-4754-8f0e-cb8541503566 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:36.745977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8d4c-129a-4754-8f0e-cb8541503566 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:36.746250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8d4c-129a-4754-8f0e-cb8541503566 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:36.747652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:36.757916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d8d4c-129a-4754-8f0e-cb8541503566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c34d8d4c-129a-4754-8f0e-cb8541503566 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:36.769091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:36.770007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:53:36.770823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:53:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:53:36.776222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d8d4c-129a-4754-8f0e-cb8541503566 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:36.824155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 8/15] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:53:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:53:36.829917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a119dd1-3b9f-44da-9683-cd5f166fa55d None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:36.873895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d8d4c-129a-4754-8f0e-cb8541503566 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:36.906932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5642c62-3c16-46b3-8467-0d9c9176daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:36.907595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5642c62-3c16-46b3-8467-0d9c9176daa3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:36.907880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5642c62-3c16-46b3-8467-0d9c9176daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:36.908156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5642c62-3c16-46b3-8467-0d9c9176daa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:36.908940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5642c62-3c16-46b3-8467-0d9c9176daa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:36.909250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5642c62-3c16-46b3-8467-0d9c9176daa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:36.910690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5642c62-3c16-46b3-8467-0d9c9176daa3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:36.922318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 8/16] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:53:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:36.926012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a119dd1-3b9f-44da-9683-cd5f166fa55d None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:36.927510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5642c62-3c16-46b3-8467-0d9c9176daa3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:36.948155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:36.954738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:36.961940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751da87-eefe-4e3a-97c2-38a8e60ece16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:36.963370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751da87-eefe-4e3a-97c2-38a8e60ece16 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:36.963691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751da87-eefe-4e3a-97c2-38a8e60ece16 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:36.964065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751da87-eefe-4e3a-97c2-38a8e60ece16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:36.974718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751da87-eefe-4e3a-97c2-38a8e60ece16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:36.976245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751da87-eefe-4e3a-97c2-38a8e60ece16 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-2751da87-eefe-4e3a-97c2-38a8e60ece16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:53:36.996811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:36.997885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:36.998779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:53:36.998779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:53:36.998779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:53:36.998779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:53:36.998779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:53:37.003686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751da87-eefe-4e3a-97c2-38a8e60ece16 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:37.029820 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5642c62-3c16-46b3-8467-0d9c9176daa3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:37.065815 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb5fae-4a7d-41a1-acd4-5262b59e9ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:37.066681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb5fae-4a7d-41a1-acd4-5262b59e9ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:37.066960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb5fae-4a7d-41a1-acd4-5262b59e9ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:37.067231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb5fae-4a7d-41a1-acd4-5262b59e9ba3 None admin] PATH_INFO: `/v3/users/97288f3cd6034b58b6dbfbe8f64b9614` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:37.068811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb5fae-4a7d-41a1-acd4-5262b59e9ba3 None admin] RBAC: Authorizing `identity:get_user(user_id=97288f3cd6034b58b6dbfbe8f64b9614)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:37.070262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb5fae-4a7d-41a1-acd4-5262b59e9ba3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:37.071872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:36 2022] GET /identity/v3/users/97288f3cd6034b58b6dbfbe8f64b9614 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:37.077714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb5fae-4a7d-41a1-acd4-5262b59e9ba3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:37.101851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751da87-eefe-4e3a-97c2-38a8e60ece16 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:37.136136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af50e5a-2dd8-4ac1-8d59-4fd8a178c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:37.136821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af50e5a-2dd8-4ac1-8d59-4fd8a178c38f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:37.137103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af50e5a-2dd8-4ac1-8d59-4fd8a178c38f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:37.137378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af50e5a-2dd8-4ac1-8d59-4fd8a178c38f None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:37.138098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af50e5a-2dd8-4ac1-8d59-4fd8a178c38f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:37.138404 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af50e5a-2dd8-4ac1-8d59-4fd8a178c38f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:37.139783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af50e5a-2dd8-4ac1-8d59-4fd8a178c38f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:37.156401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:37.172108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:37.180365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb5fae-4a7d-41a1-acd4-5262b59e9ba3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:37.218492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013f077-4fab-4317-bf61-1994b0549c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:37.219305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013f077-4fab-4317-bf61-1994b0549c3b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:37.219587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013f077-4fab-4317-bf61-1994b0549c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:37.219860 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013f077-4fab-4317-bf61-1994b0549c3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:37.221124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013f077-4fab-4317-bf61-1994b0549c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:37.222631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013f077-4fab-4317-bf61-1994b0549c3b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:37.224297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:53:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:37.230409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af50e5a-2dd8-4ac1-8d59-4fd8a178c38f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:37.266707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:37.335740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af50e5a-2dd8-4ac1-8d59-4fd8a178c38f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:37.371447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117c318-fcca-4a58-b617-a17dc4e1de90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:37.372118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c318-fcca-4a58-b617-a17dc4e1de90 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:37.372471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c318-fcca-4a58-b617-a17dc4e1de90 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:37.372795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c318-fcca-4a58-b617-a17dc4e1de90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:37.373631 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117c318-fcca-4a58-b617-a17dc4e1de90 None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.domain.id=default, user.id=97288f3cd6034b58b6dbfbe8f64b9614) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:37.373917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117c318-fcca-4a58-b617-a17dc4e1de90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:37.375375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117c318-fcca-4a58-b617-a17dc4e1de90 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:37.382433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 11/21] 10.222.0.13 () {56 vars in 1322 bytes} [Mon Jun 20 05:53:37 2022] GET /identity/v3/role_assignments?user.id=97288f3cd6034b58b6dbfbe8f64b9614&scope.domain.id=default&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:39.671697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e599fc8-810c-416b-b01a-adf7e5f71429 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:39.672728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e599fc8-810c-416b-b01a-adf7e5f71429 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:39.673211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e599fc8-810c-416b-b01a-adf7e5f71429 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:39.674803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:39.680018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec4ac2-c7a9-43c6-a8ed-36560c382eb9 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:39.680449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec4ac2-c7a9-43c6-a8ed-36560c382eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:39.680601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec4ac2-c7a9-43c6-a8ed-36560c382eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:39.705336 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-48ec4ac2-c7a9-43c6-a8ed-36560c382eb9 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:39.706812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-48ec4ac2-c7a9-43c6-a8ed-36560c382eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:39.794652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 12/23] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:39.842417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e599fc8-810c-416b-b01a-adf7e5f71429 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:39.863199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585af23f-70ce-47e8-894c-a8b1759f5166 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:39.863735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585af23f-70ce-47e8-894c-a8b1759f5166 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:39.864172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585af23f-70ce-47e8-894c-a8b1759f5166 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:39.865699 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:39.879684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96467b-b0e5-42e9-842f-94fac8c8ec61 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:39.880152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96467b-b0e5-42e9-842f-94fac8c8ec61 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:39.880606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96467b-b0e5-42e9-842f-94fac8c8ec61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:39.909350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4b96467b-b0e5-42e9-842f-94fac8c8ec61 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:39.910794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4b96467b-b0e5-42e9-842f-94fac8c8ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:39.940777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:40.030103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e599fc8-810c-416b-b01a-adf7e5f71429 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:40.039968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:40.041757 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7522a-6831-4d9f-9520-0eff3f97ea6a None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:40.042028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7522a-6831-4d9f-9520-0eff3f97ea6a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:40.042304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7522a-6831-4d9f-9520-0eff3f97ea6a None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:40.043831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 15/26] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:40.049766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0f944-f621-4971-a152-e3f92c0228ae None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:40.050048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0f944-f621-4971-a152-e3f92c0228ae None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:40.050323 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0f944-f621-4971-a152-e3f92c0228ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:40.075405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-80e0f944-f621-4971-a152-e3f92c0228ae None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:40.076621 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-80e0f944-f621-4971-a152-e3f92c0228ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:40.096733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd8bdc-02f8-4f19-ad28-9636e678ef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:40.097532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd8bdc-02f8-4f19-ad28-9636e678ef92 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:40.097806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd8bdc-02f8-4f19-ad28-9636e678ef92 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:40.098078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd8bdc-02f8-4f19-ad28-9636e678ef92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:40.119379 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd8bdc-02f8-4f19-ad28-9636e678ef92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:40.120996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd8bdc-02f8-4f19-ad28-9636e678ef92 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e8dd8bdc-02f8-4f19-ad28-9636e678ef92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:53:40.140438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:40.141330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:40.142543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:53:40.142543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:53:40.142543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:53:40.142543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:53:40.142543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 12/27] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:53:40.142543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd8bdc-02f8-4f19-ad28-9636e678ef92 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:40.161508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:40.254116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd8bdc-02f8-4f19-ad28-9636e678ef92 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:40.270643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 16/28] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:40.271866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0f944-f621-4971-a152-e3f92c0228ae None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:40.303853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974354e-1ef8-4b37-9cce-dca3f7a58f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:40.304587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974354e-1ef8-4b37-9cce-dca3f7a58f89 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:40.304878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974354e-1ef8-4b37-9cce-dca3f7a58f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:40.305160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974354e-1ef8-4b37-9cce-dca3f7a58f89 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:40.305959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974354e-1ef8-4b37-9cce-dca3f7a58f89 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:40.310643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974354e-1ef8-4b37-9cce-dca3f7a58f89 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:40.429538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:40.442344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0f944-f621-4971-a152-e3f92c0228ae None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:40.469474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 13/29] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Jun 20 05:53:40 2022] POST /identity/v3/roles => generated 219 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:53:40.476927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974354e-1ef8-4b37-9cce-dca3f7a58f89 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:40.479357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c3874-a405-4fe4-9ee2-136e2c0f8bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:40.480094 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c3874-a405-4fe4-9ee2-136e2c0f8bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:40.480458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c3874-a405-4fe4-9ee2-136e2c0f8bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:40.480741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c3874-a405-4fe4-9ee2-136e2c0f8bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:40.481531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c3874-a405-4fe4-9ee2-136e2c0f8bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:40.481849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c3874-a405-4fe4-9ee2-136e2c0f8bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:40.483491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c3874-a405-4fe4-9ee2-136e2c0f8bf8 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:40.496531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 17/30] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:40.497879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586deae5-1247-4e16-bfd9-974d2571959a None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:40.503362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586deae5-1247-4e16-bfd9-974d2571959a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:40.503667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586deae5-1247-4e16-bfd9-974d2571959a None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:40.505399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 18/31] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:40.506316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586deae5-1247-4e16-bfd9-974d2571959a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:40.590785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:40.622387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974354e-1ef8-4b37-9cce-dca3f7a58f89 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:40.655678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586deae5-1247-4e16-bfd9-974d2571959a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:40.669231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd1ee0-9adb-4c7d-9a29-5ff95ac9331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:40.670407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd1ee0-9adb-4c7d-9a29-5ff95ac9331b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:40.670701 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd1ee0-9adb-4c7d-9a29-5ff95ac9331b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:40.671126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd1ee0-9adb-4c7d-9a29-5ff95ac9331b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:40.683311 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd1ee0-9adb-4c7d-9a29-5ff95ac9331b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-d9fd1ee0-9adb-4c7d-9a29-5ff95ac9331b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:40.694364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:40.695358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:53:40.696112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 14/32] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:53:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:53:40.701088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b129246-e3a5-4b86-9776-29ebd9a67042 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:40.701359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b129246-e3a5-4b86-9776-29ebd9a67042 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:40.701653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b129246-e3a5-4b86-9776-29ebd9a67042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:40.703393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce1a72-aab9-4b11-b073-e168c44eece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:40.706149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1a72-aab9-4b11-b073-e168c44eece7 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:40.706149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1a72-aab9-4b11-b073-e168c44eece7 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:40.706149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1a72-aab9-4b11-b073-e168c44eece7 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:40.706972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce1a72-aab9-4b11-b073-e168c44eece7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:40.708518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce1a72-aab9-4b11-b073-e168c44eece7 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:40.725826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9b129246-e3a5-4b86-9776-29ebd9a67042 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:40.730949 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9b129246-e3a5-4b86-9776-29ebd9a67042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:40.742613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:40.808413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 15/33] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:40.808413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414831b0-935c-45db-a242-43b7de7c1f6d None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:40.808413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414831b0-935c-45db-a242-43b7de7c1f6d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:40.808413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414831b0-935c-45db-a242-43b7de7c1f6d None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:40.808413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 16/34] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:40.811667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414831b0-935c-45db-a242-43b7de7c1f6d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:40.860375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 19/35] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:53:40 2022] POST /identity/v3/projects => generated 301 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:53:40.861984 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ee2e3-ed91-44e0-9a08-82b5df48a3b0 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:40.862285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ee2e3-ed91-44e0-9a08-82b5df48a3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:40.862568 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ee2e3-ed91-44e0-9a08-82b5df48a3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:40.888993 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:40.890857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-341ee2e3-ed91-44e0-9a08-82b5df48a3b0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:40.893215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-341ee2e3-ed91-44e0-9a08-82b5df48a3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:40.952481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414831b0-935c-45db-a242-43b7de7c1f6d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:40.996214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46366185-39e2-471f-a395-30241fa8b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:40.996903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 20/36] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:40.998828 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ee2e3-ed91-44e0-9a08-82b5df48a3b0 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:41.001118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46366185-39e2-471f-a395-30241fa8b887 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:41.001677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46366185-39e2-471f-a395-30241fa8b887 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:41.001928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46366185-39e2-471f-a395-30241fa8b887 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:41.002805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46366185-39e2-471f-a395-30241fa8b887 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:41.004247 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46366185-39e2-471f-a395-30241fa8b887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:41.010876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46366185-39e2-471f-a395-30241fa8b887 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:41.027795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 17/37] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:53:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:41.033423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46366185-39e2-471f-a395-30241fa8b887 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:41.128089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ee2e3-ed91-44e0-9a08-82b5df48a3b0 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:41.158176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:41.166197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37112e9d-5d1f-4f1b-a284-e4fdd4b44b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:41.167030 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112e9d-5d1f-4f1b-a284-e4fdd4b44b81 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:41.167365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112e9d-5d1f-4f1b-a284-e4fdd4b44b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:41.167650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112e9d-5d1f-4f1b-a284-e4fdd4b44b81 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:41.168416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37112e9d-5d1f-4f1b-a284-e4fdd4b44b81 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:41.170060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37112e9d-5d1f-4f1b-a284-e4fdd4b44b81 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:41.170254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46366185-39e2-471f-a395-30241fa8b887 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:41.196344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 21/38] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Jun 20 05:53:40 2022] POST /identity/v3/roles => generated 225 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:53:41.196344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37112e9d-5d1f-4f1b-a284-e4fdd4b44b81 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:41.218600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:41.231675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc129eb-cc0b-4fe8-ab80-7a330ca99430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:41.232740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc129eb-cc0b-4fe8-ab80-7a330ca99430 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:41.233065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc129eb-cc0b-4fe8-ab80-7a330ca99430 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:41.233400 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc129eb-cc0b-4fe8-ab80-7a330ca99430 None admin] PATH_INFO: `/v3/users/97288f3cd6034b58b6dbfbe8f64b9614` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:41.235050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc129eb-cc0b-4fe8-ab80-7a330ca99430 None admin] RBAC: Authorizing `identity:get_user(user_id=97288f3cd6034b58b6dbfbe8f64b9614)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:41.236336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc129eb-cc0b-4fe8-ab80-7a330ca99430 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:41.238271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 18/39] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:41 2022] GET /identity/v3/users/97288f3cd6034b58b6dbfbe8f64b9614 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:41.241958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2ff43-125a-44ad-90f0-b31884664bc4 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:41.242578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2ff43-125a-44ad-90f0-b31884664bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:41.245942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2ff43-125a-44ad-90f0-b31884664bc4 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:41.246279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 19/40] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:41.248485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2ff43-125a-44ad-90f0-b31884664bc4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:41.324165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37112e9d-5d1f-4f1b-a284-e4fdd4b44b81 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:41.363753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c811fcf-f1e0-49bb-9dae-4865b6c038d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:41.364198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2ff43-125a-44ad-90f0-b31884664bc4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:41.364466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811fcf-f1e0-49bb-9dae-4865b6c038d8 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:41.364760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811fcf-f1e0-49bb-9dae-4865b6c038d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:41.365043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811fcf-f1e0-49bb-9dae-4865b6c038d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:41.365803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c811fcf-f1e0-49bb-9dae-4865b6c038d8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:41.367212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c811fcf-f1e0-49bb-9dae-4865b6c038d8 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:41.385003 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 22/41] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Jun 20 05:53:41 2022] POST /identity/v3/roles => generated 223 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:53:41.386467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325cfd-3163-452f-bf1f-e5528227c312 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:41.386810 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325cfd-3163-452f-bf1f-e5528227c312 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:41.387147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1325cfd-3163-452f-bf1f-e5528227c312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:41.405195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759e366-8090-47a2-9f9b-fc17f8408de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:41.406035 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759e366-8090-47a2-9f9b-fc17f8408de6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:41.406340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759e366-8090-47a2-9f9b-fc17f8408de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:41.406611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759e366-8090-47a2-9f9b-fc17f8408de6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:41.407977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759e366-8090-47a2-9f9b-fc17f8408de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:41.409607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759e366-8090-47a2-9f9b-fc17f8408de6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:41.411435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 20/42] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:53:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:41.418357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759e366-8090-47a2-9f9b-fc17f8408de6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:41.505840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:41.528471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-f1325cfd-3163-452f-bf1f-e5528227c312 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:41.529991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f1325cfd-3163-452f-bf1f-e5528227c312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:41.550540 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759e366-8090-47a2-9f9b-fc17f8408de6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:41.587201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e66af1-a68e-4aaf-a43d-effcc0d88ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:41.588117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66af1-a68e-4aaf-a43d-effcc0d88ddd None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:41.588439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66af1-a68e-4aaf-a43d-effcc0d88ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:41.588729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e66af1-a68e-4aaf-a43d-effcc0d88ddd None admin] PATH_INFO: `/v3/domains/default/users/97288f3cd6034b58b6dbfbe8f64b9614/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:41.589378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:41.591111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e66af1-a68e-4aaf-a43d-effcc0d88ddd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=97288f3cd6034b58b6dbfbe8f64b9614, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:41.592645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e66af1-a68e-4aaf-a43d-effcc0d88ddd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:41.608518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 21/43] 10.222.0.13 () {58 vars in 1361 bytes} [Mon Jun 20 05:53:41 2022] PUT /identity/v3/domains/default/users/97288f3cd6034b58b6dbfbe8f64b9614/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:53:41.613923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 23/44] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:41.639179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e66af1-a68e-4aaf-a43d-effcc0d88ddd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:41.741948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e66af1-a68e-4aaf-a43d-effcc0d88ddd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:41.766999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:41.779881 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5239326-ef73-4880-9179-f0a9b08041d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:41.780765 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239326-ef73-4880-9179-f0a9b08041d9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:41.781054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239326-ef73-4880-9179-f0a9b08041d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:41.781332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5239326-ef73-4880-9179-f0a9b08041d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:41.782494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5239326-ef73-4880-9179-f0a9b08041d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:41.784221 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5239326-ef73-4880-9179-f0a9b08041d9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:41.785862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 22/45] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:53:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:41.791446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1325cfd-3163-452f-bf1f-e5528227c312 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:41.887128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1325cfd-3163-452f-bf1f-e5528227c312 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:41.919972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486690-7321-44a5-890a-783b636c63a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:41.920595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486690-7321-44a5-890a-783b636c63a6 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:41.920884 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486690-7321-44a5-890a-783b636c63a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:41.921161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486690-7321-44a5-890a-783b636c63a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:41.921872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89486690-7321-44a5-890a-783b636c63a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:41.923334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89486690-7321-44a5-890a-783b636c63a6 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:41.960347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:53:41 2022] POST /identity/v3/projects => generated 312 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:53:43.600814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e96aef-6138-4b91-9748-5a0218ff37af None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:43.601299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e96aef-6138-4b91-9748-5a0218ff37af None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:43.601299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e96aef-6138-4b91-9748-5a0218ff37af None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:43.602707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 23/47] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:43.608510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a4250-0f03-447f-8153-8adda19c04ac None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:43.608907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a4250-0f03-447f-8153-8adda19c04ac None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:43.609078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a4250-0f03-447f-8153-8adda19c04ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:43.626156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8d6a4250-0f03-447f-8153-8adda19c04ac None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:43.627345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8d6a4250-0f03-447f-8153-8adda19c04ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:43.652556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:43.693862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 25/48] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:43.716623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e96aef-6138-4b91-9748-5a0218ff37af None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:43.816221 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e96aef-6138-4b91-9748-5a0218ff37af None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:43.848429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288d993-61c7-40fa-9b0d-c8499e170fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:43.849215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d993-61c7-40fa-9b0d-c8499e170fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:43.849496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d993-61c7-40fa-9b0d-c8499e170fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:43.849767 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d993-61c7-40fa-9b0d-c8499e170fd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:43.860146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288d993-61c7-40fa-9b0d-c8499e170fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6288d993-61c7-40fa-9b0d-c8499e170fd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:43.867650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:43.868674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:53:43.869691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 24/49] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:53:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:53:43.876253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a4250-0f03-447f-8153-8adda19c04ac None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:43.961309 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defc8df-437c-463d-95b9-624685723318 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:43.961667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defc8df-437c-463d-95b9-624685723318 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:43.963110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defc8df-437c-463d-95b9-624685723318 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:43.964598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 25/50] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:53:43.969685 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c841589-611a-4bca-8151-1a8ffae2801f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:43.969974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c841589-611a-4bca-8151-1a8ffae2801f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:43.970252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c841589-611a-4bca-8151-1a8ffae2801f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:43.974287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a4250-0f03-447f-8153-8adda19c04ac None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:43.987371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8c841589-611a-4bca-8151-1a8ffae2801f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:43.988595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8c841589-611a-4bca-8151-1a8ffae2801f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:44.009726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff08219-2361-409a-8654-cf467f52da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:44.010400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff08219-2361-409a-8654-cf467f52da82 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:44.010694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff08219-2361-409a-8654-cf467f52da82 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:44.010974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff08219-2361-409a-8654-cf467f52da82 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:44.011724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff08219-2361-409a-8654-cf467f52da82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:44.012039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff08219-2361-409a-8654-cf467f52da82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:44.013465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff08219-2361-409a-8654-cf467f52da82 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:44.025431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 26/51] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:53:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:44.031033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff08219-2361-409a-8654-cf467f52da82 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:44.033871 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:44.055366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:44.057704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 26/52] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:53:44.082838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c841589-611a-4bca-8151-1a8ffae2801f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:44.132402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff08219-2361-409a-8654-cf467f52da82 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:44.167117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3d603-e527-40c4-957f-c2221442c124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:44.167990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3d603-e527-40c4-957f-c2221442c124 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:44.168284 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3d603-e527-40c4-957f-c2221442c124 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:44.168601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3d603-e527-40c4-957f-c2221442c124 None admin] PATH_INFO: `/v3/users/97288f3cd6034b58b6dbfbe8f64b9614` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:44.169821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3d603-e527-40c4-957f-c2221442c124 None admin] RBAC: Authorizing `identity:get_user(user_id=97288f3cd6034b58b6dbfbe8f64b9614)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:44.171288 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3d603-e527-40c4-957f-c2221442c124 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:44.172970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:44 2022] GET /identity/v3/users/97288f3cd6034b58b6dbfbe8f64b9614 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:44.178238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3d603-e527-40c4-957f-c2221442c124 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:44.179109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c841589-611a-4bca-8151-1a8ffae2801f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:44.212522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b687a-afb6-4e82-bf2a-bafef2c9dc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:44.213323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b687a-afb6-4e82-bf2a-bafef2c9dc0f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:44.213608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b687a-afb6-4e82-bf2a-bafef2c9dc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:44.213889 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b687a-afb6-4e82-bf2a-bafef2c9dc0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:44.215065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b687a-afb6-4e82-bf2a-bafef2c9dc0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:44.216546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b687a-afb6-4e82-bf2a-bafef2c9dc0f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:44.218159 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 27/54] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:53:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:44.223448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b687a-afb6-4e82-bf2a-bafef2c9dc0f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:44.269141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:44.272142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:44.279122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3d603-e527-40c4-957f-c2221442c124 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:44.312922 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047880d-3700-47be-9234-8d9f5173ea70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:44.313708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047880d-3700-47be-9234-8d9f5173ea70 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:44.313989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047880d-3700-47be-9234-8d9f5173ea70 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:44.314272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047880d-3700-47be-9234-8d9f5173ea70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:44.315436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047880d-3700-47be-9234-8d9f5173ea70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:44.317368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047880d-3700-47be-9234-8d9f5173ea70 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:44.318985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:53:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:44.325179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047880d-3700-47be-9234-8d9f5173ea70 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:44.325534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b687a-afb6-4e82-bf2a-bafef2c9dc0f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:44.358429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3784b7f-de23-40b6-af26-56804854093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:44.359106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784b7f-de23-40b6-af26-56804854093f None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:44.359379 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784b7f-de23-40b6-af26-56804854093f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:44.359657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3784b7f-de23-40b6-af26-56804854093f None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:44.360394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3784b7f-de23-40b6-af26-56804854093f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:44.361845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3784b7f-de23-40b6-af26-56804854093f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:44.400429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 28/56] 10.222.0.13 () {60 vars in 1140 bytes} [Mon Jun 20 05:53:44 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:53:44.424251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047880d-3700-47be-9234-8d9f5173ea70 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:44.464200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed7894-04c6-4e8f-98d2-5202f57e0345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:44.464897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7894-04c6-4e8f-98d2-5202f57e0345 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:44.465183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7894-04c6-4e8f-98d2-5202f57e0345 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:44.465458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7894-04c6-4e8f-98d2-5202f57e0345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:44.466341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7894-04c6-4e8f-98d2-5202f57e0345 None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.domain.id=default, user.id=97288f3cd6034b58b6dbfbe8f64b9614) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:44.466654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7894-04c6-4e8f-98d2-5202f57e0345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:44.468128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7894-04c6-4e8f-98d2-5202f57e0345 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:44.474967 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1322 bytes} [Mon Jun 20 05:53:44 2022] GET /identity/v3/role_assignments?user.id=97288f3cd6034b58b6dbfbe8f64b9614&scope.domain.id=default&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:46.430979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c01ca-c401-450b-98ae-43a300800d29 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:46.431490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c01ca-c401-450b-98ae-43a300800d29 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:46.431609 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c01ca-c401-450b-98ae-43a300800d29 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:46.433035 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 29/58] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:46.437996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f9658-649b-40da-8f15-37f1dac75d59 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:46.438399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f9658-649b-40da-8f15-37f1dac75d59 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:46.438556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f9658-649b-40da-8f15-37f1dac75d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:46.455354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c29f9658-649b-40da-8f15-37f1dac75d59 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:46.456583 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c29f9658-649b-40da-8f15-37f1dac75d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:46.473585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:46.520738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:46.545826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c01ca-c401-450b-98ae-43a300800d29 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:46.744429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:46.749071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c01ca-c401-450b-98ae-43a300800d29 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:46.782196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edf4ca-ebd9-4f59-9638-0f1f41b60925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:46.782913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edf4ca-ebd9-4f59-9638-0f1f41b60925 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:46.783207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edf4ca-ebd9-4f59-9638-0f1f41b60925 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:46.783484 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edf4ca-ebd9-4f59-9638-0f1f41b60925 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:46.784682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edf4ca-ebd9-4f59-9638-0f1f41b60925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:46.786123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edf4ca-ebd9-4f59-9638-0f1f41b60925 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:46.787729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 30/60] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:53:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:46.793931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f9658-649b-40da-8f15-37f1dac75d59 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:46.893591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f9658-649b-40da-8f15-37f1dac75d59 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:46.926852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4421144-5e17-45b4-b548-19609287b7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:46.927513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4421144-5e17-45b4-b548-19609287b7fe None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:46.927801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4421144-5e17-45b4-b548-19609287b7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:46.928080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4421144-5e17-45b4-b548-19609287b7fe None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:46.928904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4421144-5e17-45b4-b548-19609287b7fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:46.930375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4421144-5e17-45b4-b548-19609287b7fe None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:46.954260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 31/61] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:53:46 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:53:50.075097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246977-df44-4a63-8861-ab41e3354e9d None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.076128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246977-df44-4a63-8861-ab41e3354e9d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.076644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c246977-df44-4a63-8861-ab41e3354e9d None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.078222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 31/62] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:50.096138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3795b-e5c1-4ecc-aa73-e4431722c7e8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.097053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3795b-e5c1-4ecc-aa73-e4431722c7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.097523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3795b-e5c1-4ecc-aa73-e4431722c7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.121364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-f0c3795b-e5c1-4ecc-aa73-e4431722c7e8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:50.122883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f0c3795b-e5c1-4ecc-aa73-e4431722c7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:50.126211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:50.129397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6651-e39e-44b6-9437-5065665b6657 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.129969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6651-e39e-44b6-9437-5065665b6657 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.130353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6651-e39e-44b6-9437-5065665b6657 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.132443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:50.138157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e9793-ad7b-470c-9a28-b43c50639a42 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.138438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e9793-ad7b-470c-9a28-b43c50639a42 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.138714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e9793-ad7b-470c-9a28-b43c50639a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.163322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b62e9793-ad7b-470c-9a28-b43c50639a42 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:50.164648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b62e9793-ad7b-470c-9a28-b43c50639a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:50.201769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 32/64] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:50.225155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3795b-e5c1-4ecc-aa73-e4431722c7e8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:50.344058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 33/65] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:53:50.354969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3795b-e5c1-4ecc-aa73-e4431722c7e8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:50.383387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e9793-ad7b-470c-9a28-b43c50639a42 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:50.406873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad86318-7652-4cbf-9e91-a701d1691854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:50.407680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86318-7652-4cbf-9e91-a701d1691854 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.407963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86318-7652-4cbf-9e91-a701d1691854 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.408237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad86318-7652-4cbf-9e91-a701d1691854 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.421673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:50.425157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad86318-7652-4cbf-9e91-a701d1691854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-aad86318-7652-4cbf-9e91-a701d1691854 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:50.437022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:50.437906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:53:50.438745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 33/66] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:53:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:53:50.444337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f828f02-4833-4a1e-9573-4706a2b2dc45 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.444337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f828f02-4833-4a1e-9573-4706a2b2dc45 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.444337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f828f02-4833-4a1e-9573-4706a2b2dc45 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.444337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 34/67] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:50.445440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f828f02-4833-4a1e-9573-4706a2b2dc45 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:50.500133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:50.504353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e9793-ad7b-470c-9a28-b43c50639a42 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:50.541085 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beb6cd-c4d2-4583-90d7-b1b73902fd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:50.542126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb6cd-c4d2-4583-90d7-b1b73902fd78 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.542477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb6cd-c4d2-4583-90d7-b1b73902fd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.542817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beb6cd-c4d2-4583-90d7-b1b73902fd78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.553808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3beb6cd-c4d2-4583-90d7-b1b73902fd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c3beb6cd-c4d2-4583-90d7-b1b73902fd78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:50.561995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:50.564016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:53:50.566102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:53:50.567802 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f828f02-4833-4a1e-9573-4706a2b2dc45 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:50.567949 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 34/68] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:53:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:53:50.567949 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c307a-800a-438a-8ff3-8c96d84f5870 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.567949 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c307a-800a-438a-8ff3-8c96d84f5870 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.567949 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c307a-800a-438a-8ff3-8c96d84f5870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.583834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-386c307a-800a-438a-8ff3-8c96d84f5870 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:50.585047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-386c307a-800a-438a-8ff3-8c96d84f5870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:50.604107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74195b2f-c73b-4333-9fc8-bcafa4793246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:50.604806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74195b2f-c73b-4333-9fc8-bcafa4793246 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.605091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74195b2f-c73b-4333-9fc8-bcafa4793246 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.605369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74195b2f-c73b-4333-9fc8-bcafa4793246 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.606243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74195b2f-c73b-4333-9fc8-bcafa4793246 None admin] RBAC: Adding query filter params (name=member) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:50.606556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74195b2f-c73b-4333-9fc8-bcafa4793246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:50.607950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74195b2f-c73b-4333-9fc8-bcafa4793246 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:50.617362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:53:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:50.618686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd713d1-78e3-4e8c-86e3-c437c787ec9d None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.618978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd713d1-78e3-4e8c-86e3-c437c787ec9d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.619257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd713d1-78e3-4e8c-86e3-c437c787ec9d None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.624338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 36/70] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:50.624338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd713d1-78e3-4e8c-86e3-c437c787ec9d None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:50.660337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 35/71] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:50.661467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c307a-800a-438a-8ff3-8c96d84f5870 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:50.685783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:50.725463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd713d1-78e3-4e8c-86e3-c437c787ec9d None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:50.757479 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:50.759565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b0d5f-0b36-4e6b-b099-03c4f4312224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:50.760304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b0d5f-0b36-4e6b-b099-03c4f4312224 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.760622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b0d5f-0b36-4e6b-b099-03c4f4312224 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.760898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b0d5f-0b36-4e6b-b099-03c4f4312224 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.761644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b0d5f-0b36-4e6b-b099-03c4f4312224 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:50.761959 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b0d5f-0b36-4e6b-b099-03c4f4312224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:50.763331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b0d5f-0b36-4e6b-b099-03c4f4312224 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:50.770167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c307a-800a-438a-8ff3-8c96d84f5870 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:50.771145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 37/72] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:53:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:50.772398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b6d01-38c2-42ec-9ec6-caa65775b7f0 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.772691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b6d01-38c2-42ec-9ec6-caa65775b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.772970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b6d01-38c2-42ec-9ec6-caa65775b7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.789480 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-218b6d01-38c2-42ec-9ec6-caa65775b7f0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:50.790727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-218b6d01-38c2-42ec-9ec6-caa65775b7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:50.809761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090be3c-7dee-4d04-b429-b09099e512d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:50.810632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090be3c-7dee-4d04-b429-b09099e512d6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.810915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090be3c-7dee-4d04-b429-b09099e512d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.811193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090be3c-7dee-4d04-b429-b09099e512d6 None admin] PATH_INFO: `/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.825816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090be3c-7dee-4d04-b429-b09099e512d6 None admin] RBAC: Authorizing `identity:get_user(user_id=73bcdb8c740d442ba5c3dfc9d8df69e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:50.827269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090be3c-7dee-4d04-b429-b09099e512d6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:50.828959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:50 2022] GET /identity/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:50.830134 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22c3b-502e-4470-9640-588cda9b2e19 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.830423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22c3b-502e-4470-9640-588cda9b2e19 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.830702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22c3b-502e-4470-9640-588cda9b2e19 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.835360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 37/74] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:50.835360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b22c3b-502e-4470-9640-588cda9b2e19 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:50.859188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 38/75] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:50.859953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b6d01-38c2-42ec-9ec6-caa65775b7f0 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:50.916746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:50.940651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b22c3b-502e-4470-9640-588cda9b2e19 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:50.961264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b6d01-38c2-42ec-9ec6-caa65775b7f0 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:50.973481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c1564-33a3-46f6-9343-1d5c69b45ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:50.974287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c1564-33a3-46f6-9343-1d5c69b45ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.974578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c1564-33a3-46f6-9343-1d5c69b45ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.974861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c1564-33a3-46f6-9343-1d5c69b45ce5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.985316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c1564-33a3-46f6-9343-1d5c69b45ce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-049c1564-33a3-46f6-9343-1d5c69b45ce5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:50.993389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:50.994719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 38/76] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:53:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:53:50.995974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c1564-33a3-46f6-9343-1d5c69b45ce5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:50.997017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595430e9-77a7-4820-927c-86f04c1c6c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:50.997017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595430e9-77a7-4820-927c-86f04c1c6c66 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:50.997201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595430e9-77a7-4820-927c-86f04c1c6c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:50.997482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595430e9-77a7-4820-927c-86f04c1c6c66 None admin] PATH_INFO: `/v3/users/97288f3cd6034b58b6dbfbe8f64b9614` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:50.998695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595430e9-77a7-4820-927c-86f04c1c6c66 None admin] RBAC: Authorizing `identity:get_user(user_id=97288f3cd6034b58b6dbfbe8f64b9614)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:51.000163 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595430e9-77a7-4820-927c-86f04c1c6c66 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:51.001838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 39/77] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:50 2022] GET /identity/v3/users/97288f3cd6034b58b6dbfbe8f64b9614 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:51.003165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03efcfe-838c-4289-b414-2669d7ee1d98 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:51.003292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03efcfe-838c-4289-b414-2669d7ee1d98 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:51.003532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03efcfe-838c-4289-b414-2669d7ee1d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:51.008593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:51.019347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a03efcfe-838c-4289-b414-2669d7ee1d98 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:51.020579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a03efcfe-838c-4289-b414-2669d7ee1d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:51.086231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 40/78] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:51.087069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03efcfe-838c-4289-b414-2669d7ee1d98 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:51.098595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c1564-33a3-46f6-9343-1d5c69b45ce5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:51.132864 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f773061-3039-4ca9-b6a8-239b3e2fe93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:51.133437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f773061-3039-4ca9-b6a8-239b3e2fe93c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:51.133726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f773061-3039-4ca9-b6a8-239b3e2fe93c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:51.134011 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f773061-3039-4ca9-b6a8-239b3e2fe93c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:51.138509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:51.186276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03efcfe-838c-4289-b414-2669d7ee1d98 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:51.198951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f773061-3039-4ca9-b6a8-239b3e2fe93c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:51.200474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f773061-3039-4ca9-b6a8-239b3e2fe93c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:51.207790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:51.220714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420264-6ca6-4b0c-ac2f-1c83ee252feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:51.221501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420264-6ca6-4b0c-ac2f-1c83ee252feb None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:51.221783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420264-6ca6-4b0c-ac2f-1c83ee252feb None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:51.222056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0420264-6ca6-4b0c-ac2f-1c83ee252feb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:51.223222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0420264-6ca6-4b0c-ac2f-1c83ee252feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:51.224696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0420264-6ca6-4b0c-ac2f-1c83ee252feb None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:51.226311 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 41/79] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:53:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:51.227146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420264-6ca6-4b0c-ac2f-1c83ee252feb None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:51.298574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 39/80] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:53:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:53:51.299427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f773061-3039-4ca9-b6a8-239b3e2fe93c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:51.326627 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0420264-6ca6-4b0c-ac2f-1c83ee252feb None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:51.347392 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:51.361296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6f7d2-baab-40a2-a083-77d3a1e4c559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:51.361962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f7d2-baab-40a2-a083-77d3a1e4c559 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:51.362250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f7d2-baab-40a2-a083-77d3a1e4c559 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:51.362525 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6f7d2-baab-40a2-a083-77d3a1e4c559 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:51.363275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6f7d2-baab-40a2-a083-77d3a1e4c559 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:51.363585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6f7d2-baab-40a2-a083-77d3a1e4c559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:51.365008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6f7d2-baab-40a2-a083-77d3a1e4c559 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:51.373266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 42/81] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:53:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:51.374049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6f7d2-baab-40a2-a083-77d3a1e4c559 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:51.401674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f773061-3039-4ca9-b6a8-239b3e2fe93c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:51.409328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:51.437713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e57887-b948-4fc4-a970-1cfe387e8b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:51.438355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57887-b948-4fc4-a970-1cfe387e8b2e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:51.438645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57887-b948-4fc4-a970-1cfe387e8b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:51.438923 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57887-b948-4fc4-a970-1cfe387e8b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:51.473609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6f7d2-baab-40a2-a083-77d3a1e4c559 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:51.505191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e57887-b948-4fc4-a970-1cfe387e8b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:51.506494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1e0b2-8965-4224-bf17-b28b83cf42a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:51.506662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e57887-b948-4fc4-a970-1cfe387e8b2e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:51.507289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1e0b2-8965-4224-bf17-b28b83cf42a4 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:51.507585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1e0b2-8965-4224-bf17-b28b83cf42a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:51.507872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1e0b2-8965-4224-bf17-b28b83cf42a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:51.517876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1e0b2-8965-4224-bf17-b28b83cf42a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-95f1e0b2-8965-4224-bf17-b28b83cf42a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:51.526329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:51.527202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:53:51.527955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 43/82] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:53:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:53:51.528631 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1e0b2-8965-4224-bf17-b28b83cf42a4 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:51.574061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:51.609903 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 40/83] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:53:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:53:51.610750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e57887-b948-4fc4-a970-1cfe387e8b2e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:51.618230 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:51.635236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1e0b2-8965-4224-bf17-b28b83cf42a4 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:51.668646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc100093-825a-49ae-8ac7-bbaf4f9261e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:51.669251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100093-825a-49ae-8ac7-bbaf4f9261e5 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:51.669543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100093-825a-49ae-8ac7-bbaf4f9261e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:51.669828 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc100093-825a-49ae-8ac7-bbaf4f9261e5 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:51.670558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc100093-825a-49ae-8ac7-bbaf4f9261e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:51.672028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc100093-825a-49ae-8ac7-bbaf4f9261e5 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:51.691764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 44/84] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:53:51 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:53:51.692599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc100093-825a-49ae-8ac7-bbaf4f9261e5 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:51.723514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e57887-b948-4fc4-a970-1cfe387e8b2e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:51.764606 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c02e8a-c4b8-4691-8a34-4b5bd845e329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:51.765496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c02e8a-c4b8-4691-8a34-4b5bd845e329 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:51.765787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c02e8a-c4b8-4691-8a34-4b5bd845e329 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:51.766068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c02e8a-c4b8-4691-8a34-4b5bd845e329 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:51.767337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c02e8a-c4b8-4691-8a34-4b5bd845e329 None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:51.768875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c02e8a-c4b8-4691-8a34-4b5bd845e329 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:51.775788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 41/85] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:53:51 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:51.775788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c02e8a-c4b8-4691-8a34-4b5bd845e329 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:51.807302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:51.812345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc100093-825a-49ae-8ac7-bbaf4f9261e5 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:51.854244 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a79fb-449b-49e2-a12a-cc97979ebeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:51.855130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a79fb-449b-49e2-a12a-cc97979ebeea None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:51.855420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a79fb-449b-49e2-a12a-cc97979ebeea None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:51.855704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a79fb-449b-49e2-a12a-cc97979ebeea None admin] PATH_INFO: `/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:51.856952 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a79fb-449b-49e2-a12a-cc97979ebeea None admin] RBAC: Authorizing `identity:get_user(user_id=73bcdb8c740d442ba5c3dfc9d8df69e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:51.857455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:51.858716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a79fb-449b-49e2-a12a-cc97979ebeea None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:51.860227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 45/86] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:51 2022] GET /identity/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:51.861676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a79fb-449b-49e2-a12a-cc97979ebeea None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:51.887855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c02e8a-c4b8-4691-8a34-4b5bd845e329 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:51.931097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2e4a-f2fb-4b69-ba20-18abdcdaab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:51.931707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2e4a-f2fb-4b69-ba20-18abdcdaab19 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:51.932000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2e4a-f2fb-4b69-ba20-18abdcdaab19 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:51.932284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb2e4a-f2fb-4b69-ba20-18abdcdaab19 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:51.933083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb2e4a-f2fb-4b69-ba20-18abdcdaab19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:51.933399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb2e4a-f2fb-4b69-ba20-18abdcdaab19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:51.934845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb2e4a-f2fb-4b69-ba20-18abdcdaab19 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:51.944550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 42/87] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:53:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:51.945408 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2e4a-f2fb-4b69-ba20-18abdcdaab19 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:51.987637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a79fb-449b-49e2-a12a-cc97979ebeea None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:52.038060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37d92d-2b2d-4260-a29e-f41111022473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:52.039120 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37d92d-2b2d-4260-a29e-f41111022473 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:52.039504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37d92d-2b2d-4260-a29e-f41111022473 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:52.039879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37d92d-2b2d-4260-a29e-f41111022473 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:52.041845 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37d92d-2b2d-4260-a29e-f41111022473 None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:52.043875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37d92d-2b2d-4260-a29e-f41111022473 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:52.046445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 46/88] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:53:51 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:52.047700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37d92d-2b2d-4260-a29e-f41111022473 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:52.074457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb2e4a-f2fb-4b69-ba20-18abdcdaab19 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:52.092126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:52.124267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c2c11-89ac-465c-9a3a-4893014102fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:52.125696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c2c11-89ac-465c-9a3a-4893014102fe None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:52.126441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c2c11-89ac-465c-9a3a-4893014102fe None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:52.126924 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c2c11-89ac-465c-9a3a-4893014102fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:52.128663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c2c11-89ac-465c-9a3a-4893014102fe None admin] RBAC: Adding query filter params (role.id=9734fe47b63747daa9141041f1723e55, scope.project.id=352488bb649b45819bed25de31f1156f, user.id=73bcdb8c740d442ba5c3dfc9d8df69e7) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:52.129273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c2c11-89ac-465c-9a3a-4893014102fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:52.132241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c2c11-89ac-465c-9a3a-4893014102fe None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:52.138763 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:52.145615 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 43/89] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:53:51 2022] GET /identity/v3/role_assignments?user.id=73bcdb8c740d442ba5c3dfc9d8df69e7&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=9734fe47b63747daa9141041f1723e55 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:52.153480 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c2c11-89ac-465c-9a3a-4893014102fe None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:52.168990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37d92d-2b2d-4260-a29e-f41111022473 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:52.211299 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b13f-c1c9-42fd-9ce8-96ba0b84905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:52.212816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b13f-c1c9-42fd-9ce8-96ba0b84905f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:52.213289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b13f-c1c9-42fd-9ce8-96ba0b84905f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:52.213859 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861b13f-c1c9-42fd-9ce8-96ba0b84905f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:52.293809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861b13f-c1c9-42fd-9ce8-96ba0b84905f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:52.295437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861b13f-c1c9-42fd-9ce8-96ba0b84905f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:52.321623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c2c11-89ac-465c-9a3a-4893014102fe None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:52.332992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:52.375433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6d3ae-9555-4ba6-b25d-b69a6bcb6eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:52.376333 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6d3ae-9555-4ba6-b25d-b69a6bcb6eec None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:52.376630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6d3ae-9555-4ba6-b25d-b69a6bcb6eec None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:52.376910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6d3ae-9555-4ba6-b25d-b69a6bcb6eec None admin] PATH_INFO: `/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:52.378150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6d3ae-9555-4ba6-b25d-b69a6bcb6eec None admin] RBAC: Authorizing `identity:get_user(user_id=73bcdb8c740d442ba5c3dfc9d8df69e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:52.379634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6d3ae-9555-4ba6-b25d-b69a6bcb6eec None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:52.381549 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 44/90] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:52 2022] GET /identity/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7 => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:52.382114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6d3ae-9555-4ba6-b25d-b69a6bcb6eec None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:52.406194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 47/91] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:53:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:53:52.407143 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b13f-c1c9-42fd-9ce8-96ba0b84905f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:52.502140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:52.530975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861b13f-c1c9-42fd-9ce8-96ba0b84905f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:52.570793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31f79d-5e19-40b5-9a9d-b4ef4375bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:52.572147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f79d-5e19-40b5-9a9d-b4ef4375bede None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:52.572472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f79d-5e19-40b5-9a9d-b4ef4375bede None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:52.572754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f79d-5e19-40b5-9a9d-b4ef4375bede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:52.575752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:52.582515 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6d3ae-9555-4ba6-b25d-b69a6bcb6eec None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:52.655434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31f79d-5e19-40b5-9a9d-b4ef4375bede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:52.657124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31f79d-5e19-40b5-9a9d-b4ef4375bede None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:52.674789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e32f7-0737-4549-8e59-42b4a92d3cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:52.675521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e32f7-0737-4549-8e59-42b4a92d3cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:52.675813 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e32f7-0737-4549-8e59-42b4a92d3cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:52.676098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e32f7-0737-4549-8e59-42b4a92d3cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:52.676980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e32f7-0737-4549-8e59-42b4a92d3cd1 None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=352488bb649b45819bed25de31f1156f, user.id=97288f3cd6034b58b6dbfbe8f64b9614) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:52.677300 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e32f7-0737-4549-8e59-42b4a92d3cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:52.678775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e32f7-0737-4549-8e59-42b4a92d3cd1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:52.698074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 45/92] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:53:52 2022] GET /identity/v3/role_assignments?user.id=97288f3cd6034b58b6dbfbe8f64b9614&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:52.698917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e32f7-0737-4549-8e59-42b4a92d3cd1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:52.803201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 48/93] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:53:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:53:52.814642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31f79d-5e19-40b5-9a9d-b4ef4375bede None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:52.857883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:52.948326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31f79d-5e19-40b5-9a9d-b4ef4375bede None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:52.971067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e32f7-0737-4549-8e59-42b4a92d3cd1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:53.040956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:53.048233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1279140-d967-4747-8fd0-415bec553f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:53.049434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279140-d967-4747-8fd0-415bec553f25 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:53.049652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7c89c-92ba-42de-a413-5d1fcbc529f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:53.049856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279140-d967-4747-8fd0-415bec553f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:53.050018 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1279140-d967-4747-8fd0-415bec553f25 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:53.050538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7c89c-92ba-42de-a413-5d1fcbc529f2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:53.050827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7c89c-92ba-42de-a413-5d1fcbc529f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:53.051100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7c89c-92ba-42de-a413-5d1fcbc529f2 None admin] PATH_INFO: `/v3/projects/40384cc54e3f4fedae5728aa94fe9e62` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:53.051258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1279140-d967-4747-8fd0-415bec553f25 None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:53.052885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1279140-d967-4747-8fd0-415bec553f25 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:53.057328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7c89c-92ba-42de-a413-5d1fcbc529f2 None admin] RBAC: Authorizing `identity:get_project(project_id=40384cc54e3f4fedae5728aa94fe9e62)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:53.058784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7c89c-92ba-42de-a413-5d1fcbc529f2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:53.060865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 49/94] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:53:52 2022] GET /identity/v3/projects/40384cc54e3f4fedae5728aa94fe9e62 => generated 312 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:53.062893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 46/95] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:53:52 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:53.066283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7c89c-92ba-42de-a413-5d1fcbc529f2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:53.070424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1279140-d967-4747-8fd0-415bec553f25 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:53.223113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1279140-d967-4747-8fd0-415bec553f25 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:53.291296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c928cc-db64-47fc-9285-95f7957a45bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:53.292194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c928cc-db64-47fc-9285-95f7957a45bd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:53.300577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c928cc-db64-47fc-9285-95f7957a45bd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:53.301075 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c928cc-db64-47fc-9285-95f7957a45bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:53.301459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7c89c-92ba-42de-a413-5d1fcbc529f2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:53.302942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c928cc-db64-47fc-9285-95f7957a45bd None admin] RBAC: Adding query filter params (role.id=5cdb558ab7044154896c8f9e3dfba431, scope.project.id=352488bb649b45819bed25de31f1156f, user.id=73bcdb8c740d442ba5c3dfc9d8df69e7) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:53.303405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c928cc-db64-47fc-9285-95f7957a45bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:53.305035 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c928cc-db64-47fc-9285-95f7957a45bd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:53.310095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:53.312511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 47/96] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:53:53 2022] GET /identity/v3/role_assignments?user.id=73bcdb8c740d442ba5c3dfc9d8df69e7&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=5cdb558ab7044154896c8f9e3dfba431 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:53.377182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7feb77-09c7-4980-a53a-0d40652d30a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:53.377883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7feb77-09c7-4980-a53a-0d40652d30a1 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:53.378172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7feb77-09c7-4980-a53a-0d40652d30a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:53.378453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7feb77-09c7-4980-a53a-0d40652d30a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:53.379326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7feb77-09c7-4980-a53a-0d40652d30a1 None admin] RBAC: Adding query filter params (role.id=9734fe47b63747daa9141041f1723e55, scope.project.id=40384cc54e3f4fedae5728aa94fe9e62, user.id=73bcdb8c740d442ba5c3dfc9d8df69e7) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:53.379644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7feb77-09c7-4980-a53a-0d40652d30a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:53.381149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7feb77-09c7-4980-a53a-0d40652d30a1 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:53.388090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 50/97] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:53:53 2022] GET /identity/v3/role_assignments?user.id=73bcdb8c740d442ba5c3dfc9d8df69e7&scope.project.id=40384cc54e3f4fedae5728aa94fe9e62&role.id=9734fe47b63747daa9141041f1723e55 => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:54.115368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a55109-da61-44e5-80d3-9afa908c23f1 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:54.115905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a55109-da61-44e5-80d3-9afa908c23f1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:54.116372 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a55109-da61-44e5-80d3-9afa908c23f1 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:54.117896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 48/98] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:54.125235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8f78f-adc2-4415-9bc7-54b6f65bd0d7 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:54.125699 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8f78f-adc2-4415-9bc7-54b6f65bd0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:54.126121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8f78f-adc2-4415-9bc7-54b6f65bd0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:54.148670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-0ca8f78f-adc2-4415-9bc7-54b6f65bd0d7 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:54.150112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0ca8f78f-adc2-4415-9bc7-54b6f65bd0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:54.249987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 51/99] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:54.289449 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a55109-da61-44e5-80d3-9afa908c23f1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:54.367536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:54.409718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a55109-da61-44e5-80d3-9afa908c23f1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:54.444651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf6aa6-5da5-4de2-9711-c44ecedf23c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:54.445452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf6aa6-5da5-4de2-9711-c44ecedf23c2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:54.445741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf6aa6-5da5-4de2-9711-c44ecedf23c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:54.446022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf6aa6-5da5-4de2-9711-c44ecedf23c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:54.456598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf6aa6-5da5-4de2-9711-c44ecedf23c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c6cf6aa6-5da5-4de2-9711-c44ecedf23c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:54.464885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:54.465714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:53:54.466445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 49/100] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:53:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:53:54.472930 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8f78f-adc2-4415-9bc7-54b6f65bd0d7 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:54.618117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:54.625154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8f78f-adc2-4415-9bc7-54b6f65bd0d7 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:54.667726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a3f89-71f3-4025-af53-de5e05ddb7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:54.668779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a3f89-71f3-4025-af53-de5e05ddb7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:54.669295 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a3f89-71f3-4025-af53-de5e05ddb7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:54.669790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a3f89-71f3-4025-af53-de5e05ddb7d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:54.670736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a3f89-71f3-4025-af53-de5e05ddb7d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:54.671239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a3f89-71f3-4025-af53-de5e05ddb7d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:54.672858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a3f89-71f3-4025-af53-de5e05ddb7d0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:54.686994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 52/101] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:53:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:54.692579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf6aa6-5da5-4de2-9711-c44ecedf23c2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:54.708370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f44e1-ede7-4706-acaf-d21535bccfc5 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:54.708946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f44e1-ede7-4706-acaf-d21535bccfc5 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:54.709522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f44e1-ede7-4706-acaf-d21535bccfc5 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:54.711121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 53/102] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:53:54.716227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282c2eb-f0cd-42a0-8699-545c6bf68471 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:54.717122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282c2eb-f0cd-42a0-8699-545c6bf68471 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:54.717598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282c2eb-f0cd-42a0-8699-545c6bf68471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:54.741784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-1282c2eb-f0cd-42a0-8699-545c6bf68471 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:54.743373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1282c2eb-f0cd-42a0-8699-545c6bf68471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:54.825608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf6aa6-5da5-4de2-9711-c44ecedf23c2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:54.836377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 54/103] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:54.849210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:54.860645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43010070-29a9-493f-8883-68ac80e46717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:54.861528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43010070-29a9-493f-8883-68ac80e46717 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:54.861817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43010070-29a9-493f-8883-68ac80e46717 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:54.862096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43010070-29a9-493f-8883-68ac80e46717 None admin] PATH_INFO: `/v3/users/6da373495612459eaeec3853d99a61c6` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:54.875289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282c2eb-f0cd-42a0-8699-545c6bf68471 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:54.876286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43010070-29a9-493f-8883-68ac80e46717 None admin] RBAC: Authorizing `identity:get_user(user_id=6da373495612459eaeec3853d99a61c6)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:54.877825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43010070-29a9-493f-8883-68ac80e46717 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:54.879865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 50/104] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:54 2022] GET /identity/v3/users/6da373495612459eaeec3853d99a61c6 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:54.885683 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43010070-29a9-493f-8883-68ac80e46717 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:54.990775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43010070-29a9-493f-8883-68ac80e46717 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:55.030187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcf688-a7a0-4eec-b24f-e65fd4197cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:55.030856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcf688-a7a0-4eec-b24f-e65fd4197cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:55.031146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcf688-a7a0-4eec-b24f-e65fd4197cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:55.031433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcf688-a7a0-4eec-b24f-e65fd4197cb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:55.032815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:55.074405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282c2eb-f0cd-42a0-8699-545c6bf68471 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:55.090641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:55.110799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcf688-a7a0-4eec-b24f-e65fd4197cb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:55.112332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcf688-a7a0-4eec-b24f-e65fd4197cb3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:55.209688 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859090b2-6e0a-4031-a138-718b86a6a032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:55.210422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859090b2-6e0a-4031-a138-718b86a6a032 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:55.210710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859090b2-6e0a-4031-a138-718b86a6a032 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:55.210988 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859090b2-6e0a-4031-a138-718b86a6a032 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:55.216763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859090b2-6e0a-4031-a138-718b86a6a032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:55.218295 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859090b2-6e0a-4031-a138-718b86a6a032 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:55.221176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 55/105] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:53:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:55.222274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 51/106] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:53:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:53:55.226800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859090b2-6e0a-4031-a138-718b86a6a032 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:55.228104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcf688-a7a0-4eec-b24f-e65fd4197cb3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:55.319608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:55.342065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcf688-a7a0-4eec-b24f-e65fd4197cb3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:55.378397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977051a-7fec-43b6-ae7b-c25222c9e02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:55.379538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977051a-7fec-43b6-ae7b-c25222c9e02b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:55.379974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977051a-7fec-43b6-ae7b-c25222c9e02b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:55.380426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977051a-7fec-43b6-ae7b-c25222c9e02b None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:55.381784 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977051a-7fec-43b6-ae7b-c25222c9e02b None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:55.383406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977051a-7fec-43b6-ae7b-c25222c9e02b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:55.385901 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 52/107] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:53:55 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:55.398095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977051a-7fec-43b6-ae7b-c25222c9e02b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:55.453472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859090b2-6e0a-4031-a138-718b86a6a032 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:55.495025 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726829f-3c5b-4b16-a554-fac392ae7449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:55.496540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726829f-3c5b-4b16-a554-fac392ae7449 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:55.497000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726829f-3c5b-4b16-a554-fac392ae7449 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:55.497429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726829f-3c5b-4b16-a554-fac392ae7449 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:55.498554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726829f-3c5b-4b16-a554-fac392ae7449 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:55.500746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726829f-3c5b-4b16-a554-fac392ae7449 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:55.543405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 56/108] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:53:55 2022] POST /identity/v3/projects => generated 302 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:53:55.546561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a06d5-48d5-44d6-a7e4-cbaeca57d2df None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:55.547025 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a06d5-48d5-44d6-a7e4-cbaeca57d2df None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:55.547324 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a06d5-48d5-44d6-a7e4-cbaeca57d2df None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:55.549402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 57/109] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:55.551735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb26810-3762-4bb7-8e7b-1fd076c1e0a5 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:55.552027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb26810-3762-4bb7-8e7b-1fd076c1e0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:55.552334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb26810-3762-4bb7-8e7b-1fd076c1e0a5 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:55.559532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 58/110] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:55.561090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7efe23-4a5b-4565-9a8b-ec17e117a300 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:55.561386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7efe23-4a5b-4565-9a8b-ec17e117a300 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:55.561832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7efe23-4a5b-4565-9a8b-ec17e117a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:55.577366 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977051a-7fec-43b6-ae7b-c25222c9e02b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:55.588990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-2d7efe23-4a5b-4565-9a8b-ec17e117a300 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:55.590986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2d7efe23-4a5b-4565-9a8b-ec17e117a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:55.594056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:55.652982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197292e9-e3d0-4598-8ac7-1aa12d53617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:55.654168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197292e9-e3d0-4598-8ac7-1aa12d53617c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:55.654657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197292e9-e3d0-4598-8ac7-1aa12d53617c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:55.655181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197292e9-e3d0-4598-8ac7-1aa12d53617c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:55.656396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197292e9-e3d0-4598-8ac7-1aa12d53617c None admin] RBAC: Adding query filter params (role.id=89ec31929ee14f1a94fa3a1f8cbd9438, scope.project.id=352488bb649b45819bed25de31f1156f, user.id=6da373495612459eaeec3853d99a61c6) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:55.657933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197292e9-e3d0-4598-8ac7-1aa12d53617c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:55.660627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197292e9-e3d0-4598-8ac7-1aa12d53617c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:55.673655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 53/111] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:53:55 2022] GET /identity/v3/role_assignments?user.id=6da373495612459eaeec3853d99a61c6&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=89ec31929ee14f1a94fa3a1f8cbd9438 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:55.678765 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59c6ef-7594-4625-9ae2-dd2ffdc644b6 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:55.679339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59c6ef-7594-4625-9ae2-dd2ffdc644b6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:55.679822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59c6ef-7594-4625-9ae2-dd2ffdc644b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:55.713030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-db59c6ef-7594-4625-9ae2-dd2ffdc644b6 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:55.716900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-db59c6ef-7594-4625-9ae2-dd2ffdc644b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:55.740001 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:55.742867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 59/112] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:55.768242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7efe23-4a5b-4565-9a8b-ec17e117a300 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:55.849761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 54/113] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:55.895951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59c6ef-7594-4625-9ae2-dd2ffdc644b6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:55.919698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7efe23-4a5b-4565-9a8b-ec17e117a300 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:55.963510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c3116-4a52-441c-a041-4aecd4075af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:55.965293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c3116-4a52-441c-a041-4aecd4075af5 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:55.965832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c3116-4a52-441c-a041-4aecd4075af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:55.966318 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c3116-4a52-441c-a041-4aecd4075af5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:55.979153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:55.988784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c3116-4a52-441c-a041-4aecd4075af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-d61c3116-4a52-441c-a041-4aecd4075af5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:55.998895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:55.999766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:53:56.000558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 60/114] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:53:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:53:56.006016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c3116-4a52-441c-a041-4aecd4075af5 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:56.058953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59c6ef-7594-4625-9ae2-dd2ffdc644b6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:56.095022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d2f6-d072-4b8d-9d63-4fa5250d92bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:56.095829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d2f6-d072-4b8d-9d63-4fa5250d92bc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:56.096117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d2f6-d072-4b8d-9d63-4fa5250d92bc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:56.096435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370d2f6-d072-4b8d-9d63-4fa5250d92bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:56.116710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370d2f6-d072-4b8d-9d63-4fa5250d92bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f370d2f6-d072-4b8d-9d63-4fa5250d92bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:56.125587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:56.126428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:53:56.127188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 55/115] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:53:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:53:56.134391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d2f6-d072-4b8d-9d63-4fa5250d92bc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:56.138857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:56.261639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370d2f6-d072-4b8d-9d63-4fa5250d92bc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:56.298327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c3116-4a52-441c-a041-4aecd4075af5 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:56.299323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d8e59-5b4e-49a9-845f-35f5005fd971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:56.300167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d8e59-5b4e-49a9-845f-35f5005fd971 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:56.300495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d8e59-5b4e-49a9-845f-35f5005fd971 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:56.300780 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d8e59-5b4e-49a9-845f-35f5005fd971 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:56.301544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d8e59-5b4e-49a9-845f-35f5005fd971 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:56.301859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d8e59-5b4e-49a9-845f-35f5005fd971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:56.303270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d8e59-5b4e-49a9-845f-35f5005fd971 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:56.313455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 56/116] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:56.319301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d8e59-5b4e-49a9-845f-35f5005fd971 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:56.385046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797098c7-98b6-4904-b1dc-5aee9be86025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:56.385741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797098c7-98b6-4904-b1dc-5aee9be86025 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:56.386034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797098c7-98b6-4904-b1dc-5aee9be86025 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:56.386314 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797098c7-98b6-4904-b1dc-5aee9be86025 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:56.387081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797098c7-98b6-4904-b1dc-5aee9be86025 None admin] RBAC: Adding query filter params (name=member) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:56.387396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797098c7-98b6-4904-b1dc-5aee9be86025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:56.388825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797098c7-98b6-4904-b1dc-5aee9be86025 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:56.390955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:56.406865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 61/117] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:53:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:56.411827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797098c7-98b6-4904-b1dc-5aee9be86025 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:56.430285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d8e59-5b4e-49a9-845f-35f5005fd971 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:56.467326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58001c8-4bcc-4f7b-8dc0-a6a2e47ca404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:56.468219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58001c8-4bcc-4f7b-8dc0-a6a2e47ca404 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:56.468536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58001c8-4bcc-4f7b-8dc0-a6a2e47ca404 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:56.468822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58001c8-4bcc-4f7b-8dc0-a6a2e47ca404 None admin] PATH_INFO: `/v3/users/97288f3cd6034b58b6dbfbe8f64b9614` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:56.470126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58001c8-4bcc-4f7b-8dc0-a6a2e47ca404 None admin] RBAC: Authorizing `identity:get_user(user_id=97288f3cd6034b58b6dbfbe8f64b9614)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:56.471733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58001c8-4bcc-4f7b-8dc0-a6a2e47ca404 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:56.473858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 57/118] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:56 2022] GET /identity/v3/users/97288f3cd6034b58b6dbfbe8f64b9614 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:56.475110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca04ce3-0d8f-4927-b358-150707b45ac8 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:56.475589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca04ce3-0d8f-4927-b358-150707b45ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:56.480497 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca04ce3-0d8f-4927-b358-150707b45ac8 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:56.482385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 58/119] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:56.485643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca04ce3-0d8f-4927-b358-150707b45ac8 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:56.525412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:56.600267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca04ce3-0d8f-4927-b358-150707b45ac8 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:56.606096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797098c7-98b6-4904-b1dc-5aee9be86025 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:56.635193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e1b7d-9e04-4959-9b2f-4b0cbc43f693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:56.636117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1b7d-9e04-4959-9b2f-4b0cbc43f693 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:56.636455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1b7d-9e04-4959-9b2f-4b0cbc43f693 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:56.636740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1b7d-9e04-4959-9b2f-4b0cbc43f693 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:56.637996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e1b7d-9e04-4959-9b2f-4b0cbc43f693 None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:56.639588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e1b7d-9e04-4959-9b2f-4b0cbc43f693 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:56.643218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 59/120] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:53:56 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:56.650108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028973b1-3327-41ab-8277-cdac81c0282e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:56.650794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028973b1-3327-41ab-8277-cdac81c0282e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:56.652593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028973b1-3327-41ab-8277-cdac81c0282e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:56.664891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:56.683738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-028973b1-3327-41ab-8277-cdac81c0282e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:56.685098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4061a-9020-4f37-b17b-2b6c56ce1c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:56.686071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4061a-9020-4f37-b17b-2b6c56ce1c4e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:56.686358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4061a-9020-4f37-b17b-2b6c56ce1c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:56.686637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4061a-9020-4f37-b17b-2b6c56ce1c4e None admin] PATH_INFO: `/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:56.688279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-028973b1-3327-41ab-8277-cdac81c0282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:56.688996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4061a-9020-4f37-b17b-2b6c56ce1c4e None admin] RBAC: Authorizing `identity:get_user(user_id=73bcdb8c740d442ba5c3dfc9d8df69e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:56.691795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4061a-9020-4f37-b17b-2b6c56ce1c4e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:56.694052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 62/121] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:56 2022] GET /identity/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:53:56.694820 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4061a-9020-4f37-b17b-2b6c56ce1c4e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:56.836419 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 60/122] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:56.838960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028973b1-3327-41ab-8277-cdac81c0282e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:56.856838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4061a-9020-4f37-b17b-2b6c56ce1c4e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:56.896214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:56.907431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be16251-e32d-4ab1-8b8a-783050a2a13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:56.908351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16251-e32d-4ab1-8b8a-783050a2a13a None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:56.908653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16251-e32d-4ab1-8b8a-783050a2a13a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:56.908938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16251-e32d-4ab1-8b8a-783050a2a13a None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f/users/97288f3cd6034b58b6dbfbe8f64b9614/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:56.911543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be16251-e32d-4ab1-8b8a-783050a2a13a None admin] RBAC: Authorizing `identity:create_grant(project_id=352488bb649b45819bed25de31f1156f, user_id=97288f3cd6034b58b6dbfbe8f64b9614, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:56.913323 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be16251-e32d-4ab1-8b8a-783050a2a13a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:56.933931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 63/123] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:53:56 2022] PUT /identity/v3/projects/352488bb649b45819bed25de31f1156f/users/97288f3cd6034b58b6dbfbe8f64b9614/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:53:56.935341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f38748-26fa-4012-bd7a-71e5b058bb12 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:56.935651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f38748-26fa-4012-bd7a-71e5b058bb12 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:56.935937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f38748-26fa-4012-bd7a-71e5b058bb12 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:56.937718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 64/124] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:56.938510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f38748-26fa-4012-bd7a-71e5b058bb12 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:57.000769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028973b1-3327-41ab-8277-cdac81c0282e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:57.068935 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:57.090128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a32c-29a1-4332-b3cc-3dfab927f30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:57.091093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a32c-29a1-4332-b3cc-3dfab927f30a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:57.091390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a32c-29a1-4332-b3cc-3dfab927f30a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:57.091675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a32c-29a1-4332-b3cc-3dfab927f30a None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:57.097289 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a32c-29a1-4332-b3cc-3dfab927f30a None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:57.098618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a32c-29a1-4332-b3cc-3dfab927f30a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:57.100516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 61/125] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:53:56 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:57.101774 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500d29c-16c2-4d8a-9fbf-c3646da5502f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:57.102014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500d29c-16c2-4d8a-9fbf-c3646da5502f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:57.102299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500d29c-16c2-4d8a-9fbf-c3646da5502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:57.125476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f38748-26fa-4012-bd7a-71e5b058bb12 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:57.130189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b500d29c-16c2-4d8a-9fbf-c3646da5502f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:57.131463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b500d29c-16c2-4d8a-9fbf-c3646da5502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:57.169792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2986101-583c-4eca-98ba-e29553337167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:57.170930 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986101-583c-4eca-98ba-e29553337167 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:57.171399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986101-583c-4eca-98ba-e29553337167 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:57.171868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2986101-583c-4eca-98ba-e29553337167 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:57.185387 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2986101-583c-4eca-98ba-e29553337167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-c2986101-583c-4eca-98ba-e29553337167 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:57.194008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:57.194852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:53:57.195594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:53:57.198843 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 65/126] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:53:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:53:57.199868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2986101-583c-4eca-98ba-e29553337167 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:57.212437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 62/127] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:53:57.218326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500d29c-16c2-4d8a-9fbf-c3646da5502f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:57.260277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:57.348939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2986101-583c-4eca-98ba-e29553337167 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:57.349477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500d29c-16c2-4d8a-9fbf-c3646da5502f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:57.380595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:57.385323 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ab18-f385-4367-8121-03168b9bde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:57.386454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ab18-f385-4367-8121-03168b9bde54 None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:57.386748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ab18-f385-4367-8121-03168b9bde54 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:57.387030 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ab18-f385-4367-8121-03168b9bde54 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f/users/73bcdb8c740d442ba5c3dfc9d8df69e7/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:57.389055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ab18-f385-4367-8121-03168b9bde54 None admin] RBAC: Authorizing `identity:create_grant(project_id=352488bb649b45819bed25de31f1156f, user_id=73bcdb8c740d442ba5c3dfc9d8df69e7, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:57.390650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ab18-f385-4367-8121-03168b9bde54 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:57.393728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c01f3-8685-4952-9471-b6f9153785e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:57.394965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c01f3-8685-4952-9471-b6f9153785e6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:57.395373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c01f3-8685-4952-9471-b6f9153785e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:57.395805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c01f3-8685-4952-9471-b6f9153785e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:57.400460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c01f3-8685-4952-9471-b6f9153785e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:57.400845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c01f3-8685-4952-9471-b6f9153785e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:57.402735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c01f3-8685-4952-9471-b6f9153785e6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:57.407192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 66/128] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:53:57 2022] PUT /identity/v3/projects/352488bb649b45819bed25de31f1156f/users/73bcdb8c740d442ba5c3dfc9d8df69e7/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:53:57.408270 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ab18-f385-4367-8121-03168b9bde54 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:57.422810 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 63/129] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:53:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:57.427593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c01f3-8685-4952-9471-b6f9153785e6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:57.620704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c01f3-8685-4952-9471-b6f9153785e6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:57.667875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796295e-bcdb-4b8f-936e-c4fe14484eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:57.668751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796295e-bcdb-4b8f-936e-c4fe14484eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:57.669036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796295e-bcdb-4b8f-936e-c4fe14484eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:57.669318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796295e-bcdb-4b8f-936e-c4fe14484eb5 None admin] PATH_INFO: `/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:57.670703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796295e-bcdb-4b8f-936e-c4fe14484eb5 None admin] RBAC: Authorizing `identity:get_user(user_id=73bcdb8c740d442ba5c3dfc9d8df69e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:57.672301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796295e-bcdb-4b8f-936e-c4fe14484eb5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:57.673985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 64/130] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:57 2022] GET /identity/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:57.674175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ab18-f385-4367-8121-03168b9bde54 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:57.688006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:57.688873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796295e-bcdb-4b8f-936e-c4fe14484eb5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:57.716588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa788b80-a936-45be-932c-36829e824341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:57.717401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa788b80-a936-45be-932c-36829e824341 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:57.717690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa788b80-a936-45be-932c-36829e824341 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:57.718144 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa788b80-a936-45be-932c-36829e824341 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:57.730441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa788b80-a936-45be-932c-36829e824341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-aa788b80-a936-45be-932c-36829e824341 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:57.739128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:57.739971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:53:57.740756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 67/131] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:53:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:53:57.749376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa788b80-a936-45be-932c-36829e824341 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:57.833368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:57.861894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa788b80-a936-45be-932c-36829e824341 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:57.897466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f2afe-72cc-47e5-ac1f-4273428a3aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:57.898377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f2afe-72cc-47e5-ac1f-4273428a3aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:57.898840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f2afe-72cc-47e5-ac1f-4273428a3aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:57.899261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f2afe-72cc-47e5-ac1f-4273428a3aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:57.900754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f2afe-72cc-47e5-ac1f-4273428a3aa8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:57.901466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f2afe-72cc-47e5-ac1f-4273428a3aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:57.903206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f2afe-72cc-47e5-ac1f-4273428a3aa8 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:57.919811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 68/132] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:53:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:57.928548 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f2afe-72cc-47e5-ac1f-4273428a3aa8 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:57.930825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796295e-bcdb-4b8f-936e-c4fe14484eb5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:58.014447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:58.021076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce12d16-464f-4703-bf5d-4eb5a0ebf0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:58.021959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12d16-464f-4703-bf5d-4eb5a0ebf0bf None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:58.022240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12d16-464f-4703-bf5d-4eb5a0ebf0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:58.025514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12d16-464f-4703-bf5d-4eb5a0ebf0bf None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:58.027568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce12d16-464f-4703-bf5d-4eb5a0ebf0bf None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:58.029077 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce12d16-464f-4703-bf5d-4eb5a0ebf0bf None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:58.040673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 65/133] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:53:57 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:58.041553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce12d16-464f-4703-bf5d-4eb5a0ebf0bf None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:58.174272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce12d16-464f-4703-bf5d-4eb5a0ebf0bf None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:58.204762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:58.213994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f2afe-72cc-47e5-ac1f-4273428a3aa8 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:58.215212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137c49e-f995-4464-96fb-a3f279d14ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:58.217261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137c49e-f995-4464-96fb-a3f279d14ad6 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:58.217806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137c49e-f995-4464-96fb-a3f279d14ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:58.218288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137c49e-f995-4464-96fb-a3f279d14ad6 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f/users/73bcdb8c740d442ba5c3dfc9d8df69e7/roles/5cdb558ab7044154896c8f9e3dfba431` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:58.220850 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137c49e-f995-4464-96fb-a3f279d14ad6 None admin] RBAC: Authorizing `identity:create_grant(project_id=352488bb649b45819bed25de31f1156f, user_id=73bcdb8c740d442ba5c3dfc9d8df69e7, role_id=5cdb558ab7044154896c8f9e3dfba431)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:58.223403 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137c49e-f995-4464-96fb-a3f279d14ad6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:58.250941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 66/134] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:53:58 2022] PUT /identity/v3/projects/352488bb649b45819bed25de31f1156f/users/73bcdb8c740d442ba5c3dfc9d8df69e7/roles/5cdb558ab7044154896c8f9e3dfba431 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:53:58.278866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932993d0-9bbc-4607-8349-3f42723a0644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:58.279821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932993d0-9bbc-4607-8349-3f42723a0644 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:58.280167 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932993d0-9bbc-4607-8349-3f42723a0644 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:58.280517 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932993d0-9bbc-4607-8349-3f42723a0644 None admin] PATH_INFO: `/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:58.282079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932993d0-9bbc-4607-8349-3f42723a0644 None admin] RBAC: Authorizing `identity:get_user(user_id=73bcdb8c740d442ba5c3dfc9d8df69e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:58.283608 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932993d0-9bbc-4607-8349-3f42723a0644 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:58.285665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 69/135] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:57 2022] GET /identity/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7 => generated 275 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:58.291521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137c49e-f995-4464-96fb-a3f279d14ad6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:58.415734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137c49e-f995-4464-96fb-a3f279d14ad6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:58.441746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92ef6-475d-4146-8097-1585e12e2169 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:58.442046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92ef6-475d-4146-8097-1585e12e2169 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:58.442229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da92ef6-475d-4146-8097-1585e12e2169 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:58.443956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 70/136] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:58.449665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4999d02-23b9-42e3-8c43-fdb4154fbe70 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:58.449960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4999d02-23b9-42e3-8c43-fdb4154fbe70 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:58.450247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4999d02-23b9-42e3-8c43-fdb4154fbe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:58.474044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d4999d02-23b9-42e3-8c43-fdb4154fbe70 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:58.475256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d4999d02-23b9-42e3-8c43-fdb4154fbe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:58.491674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412dbed-02f0-433b-9dd8-58b0f70e8b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:58.492598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412dbed-02f0-433b-9dd8-58b0f70e8b00 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:58.492950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412dbed-02f0-433b-9dd8-58b0f70e8b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:58.493297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412dbed-02f0-433b-9dd8-58b0f70e8b00 None admin] PATH_INFO: `/v3/projects/40384cc54e3f4fedae5728aa94fe9e62` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:58.495693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412dbed-02f0-433b-9dd8-58b0f70e8b00 None admin] RBAC: Authorizing `identity:get_project(project_id=40384cc54e3f4fedae5728aa94fe9e62)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:58.497199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412dbed-02f0-433b-9dd8-58b0f70e8b00 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:58.500706 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 67/137] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:53:58 2022] GET /identity/v3/projects/40384cc54e3f4fedae5728aa94fe9e62 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:58.522870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412dbed-02f0-433b-9dd8-58b0f70e8b00 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:58.597532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 71/138] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 20 05:53:58.612776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:58.624211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4999d02-23b9-42e3-8c43-fdb4154fbe70 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:58.661081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:58.672750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412dbed-02f0-433b-9dd8-58b0f70e8b00 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:58.752839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4999d02-23b9-42e3-8c43-fdb4154fbe70 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:58.756250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59506dff-0fd8-4e66-8660-09a6d63a6029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:58.757183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506dff-0fd8-4e66-8660-09a6d63a6029 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:58.757470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506dff-0fd8-4e66-8660-09a6d63a6029 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:58.757750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506dff-0fd8-4e66-8660-09a6d63a6029 None admin] PATH_INFO: `/v3/projects/40384cc54e3f4fedae5728aa94fe9e62/users/73bcdb8c740d442ba5c3dfc9d8df69e7/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:58.761338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59506dff-0fd8-4e66-8660-09a6d63a6029 None admin] RBAC: Authorizing `identity:create_grant(project_id=40384cc54e3f4fedae5728aa94fe9e62, user_id=73bcdb8c740d442ba5c3dfc9d8df69e7, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:58.762806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59506dff-0fd8-4e66-8660-09a6d63a6029 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:58.790056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 68/139] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:53:58 2022] PUT /identity/v3/projects/40384cc54e3f4fedae5728aa94fe9e62/users/73bcdb8c740d442ba5c3dfc9d8df69e7/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:53:58.792043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2704-a10b-41e6-85b4-994e8d169b14 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:58.792343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2704-a10b-41e6-85b4-994e8d169b14 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:58.792631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2704-a10b-41e6-85b4-994e8d169b14 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:58.796577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 69/140] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:53:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:53:58.802264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57d2c-508c-48be-9fa6-2c6b407eae3f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:58.802599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57d2c-508c-48be-9fa6-2c6b407eae3f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:58.802887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc57d2c-508c-48be-9fa6-2c6b407eae3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:58.831116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9633bfd-e9e9-4c26-b9f7-b4c36c33d73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:58.831998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633bfd-e9e9-4c26-b9f7-b4c36c33d73c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:58.832291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633bfd-e9e9-4c26-b9f7-b4c36c33d73c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:58.832595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9633bfd-e9e9-4c26-b9f7-b4c36c33d73c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:58.834531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9633bfd-e9e9-4c26-b9f7-b4c36c33d73c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:58.835056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-dcc57d2c-508c-48be-9fa6-2c6b407eae3f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:53:58.838097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dcc57d2c-508c-48be-9fa6-2c6b407eae3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:53:58.840442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9633bfd-e9e9-4c26-b9f7-b4c36c33d73c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:58.842276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 72/141] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:53:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:58.848546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9633bfd-e9e9-4c26-b9f7-b4c36c33d73c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:58.998776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 70/142] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:53:59.007654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:59.015641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9633bfd-e9e9-4c26-b9f7-b4c36c33d73c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:59.046432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc57d2c-508c-48be-9fa6-2c6b407eae3f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:59.062275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1649a6-0dec-467b-8349-b769dbb95306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:59.062980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1649a6-0dec-467b-8349-b769dbb95306 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:59.063269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1649a6-0dec-467b-8349-b769dbb95306 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:59.063542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1649a6-0dec-467b-8349-b769dbb95306 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:59.064275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1649a6-0dec-467b-8349-b769dbb95306 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:59.065958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1649a6-0dec-467b-8349-b769dbb95306 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:59.103629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 73/143] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:53:58 2022] POST /identity/v3/users => generated 283 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:53:59.130388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:59.191781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc57d2c-508c-48be-9fa6-2c6b407eae3f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:59.232802 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e574c-409c-4b70-af77-14e81f5ef97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:59.233563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e574c-409c-4b70-af77-14e81f5ef97d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:59.233855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e574c-409c-4b70-af77-14e81f5ef97d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:59.234135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e574c-409c-4b70-af77-14e81f5ef97d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:59.248351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e574c-409c-4b70-af77-14e81f5ef97d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-b84e574c-409c-4b70-af77-14e81f5ef97d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:53:59.254795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:53:59.255728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:53:59.256577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 71/144] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:53:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:53:59.266544 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1649a6-0dec-467b-8349-b769dbb95306 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:59.397235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1649a6-0dec-467b-8349-b769dbb95306 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:59.438292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d94b03-dc7e-4be9-83ce-fba612230d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:59.439056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94b03-dc7e-4be9-83ce-fba612230d33 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:59.439355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94b03-dc7e-4be9-83ce-fba612230d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:59.439630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94b03-dc7e-4be9-83ce-fba612230d33 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:59.440473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d94b03-dc7e-4be9-83ce-fba612230d33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:53:59.440786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d94b03-dc7e-4be9-83ce-fba612230d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:59.442172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d94b03-dc7e-4be9-83ce-fba612230d33 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:59.455773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 74/145] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:53:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:59.461021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e574c-409c-4b70-af77-14e81f5ef97d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:59.581409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e574c-409c-4b70-af77-14e81f5ef97d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:59.593272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:59.622953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a6557-3976-445e-916a-08e54d2cc9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:59.623843 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a6557-3976-445e-916a-08e54d2cc9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:59.624131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a6557-3976-445e-916a-08e54d2cc9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:59.624462 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a6557-3976-445e-916a-08e54d2cc9d2 None admin] PATH_INFO: `/v3/users/6da373495612459eaeec3853d99a61c6` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:59.625764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a6557-3976-445e-916a-08e54d2cc9d2 None admin] RBAC: Authorizing `identity:get_user(user_id=6da373495612459eaeec3853d99a61c6)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:59.627283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a6557-3976-445e-916a-08e54d2cc9d2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:59.629230 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 72/146] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:53:59 2022] GET /identity/v3/users/6da373495612459eaeec3853d99a61c6 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:59.634552 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d94b03-dc7e-4be9-83ce-fba612230d33 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:59.652678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:53:59.746154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d94b03-dc7e-4be9-83ce-fba612230d33 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:59.782651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d15636-b81f-4b79-aac1-4479c21b29ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:59.783518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15636-b81f-4b79-aac1-4479c21b29ff None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:59.783806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15636-b81f-4b79-aac1-4479c21b29ff None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:59.784082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15636-b81f-4b79-aac1-4479c21b29ff None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:59.785971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d15636-b81f-4b79-aac1-4479c21b29ff None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:59.787445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d15636-b81f-4b79-aac1-4479c21b29ff None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:59.789492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 75/147] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:53:59 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:53:59.795177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a6557-3976-445e-916a-08e54d2cc9d2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:53:59.910848 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a6557-3976-445e-916a-08e54d2cc9d2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:53:59.948038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb3350-a782-4de5-8a2d-61873131ac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:53:59.948959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3350-a782-4de5-8a2d-61873131ac59 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:53:59.949390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3350-a782-4de5-8a2d-61873131ac59 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:53:59.949550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb3350-a782-4de5-8a2d-61873131ac59 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f/users/6da373495612459eaeec3853d99a61c6/roles/89ec31929ee14f1a94fa3a1f8cbd9438` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:53:59.951883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb3350-a782-4de5-8a2d-61873131ac59 None admin] RBAC: Authorizing `identity:create_grant(project_id=352488bb649b45819bed25de31f1156f, user_id=6da373495612459eaeec3853d99a61c6, role_id=89ec31929ee14f1a94fa3a1f8cbd9438)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:53:59.953391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb3350-a782-4de5-8a2d-61873131ac59 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:53:59.972621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 73/148] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:53:59 2022] PUT /identity/v3/projects/352488bb649b45819bed25de31f1156f/users/6da373495612459eaeec3853d99a61c6/roles/89ec31929ee14f1a94fa3a1f8cbd9438 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:54:00.196905 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6edd8-22dd-4659-92ff-0b6a7c45e6e0 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:00.197257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6edd8-22dd-4659-92ff-0b6a7c45e6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:00.197428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6edd8-22dd-4659-92ff-0b6a7c45e6e0 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:00.198786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 76/149] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:00.204579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a31f9-bc5f-43a4-a1f4-864ad410f0f8 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:00.204879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a31f9-bc5f-43a4-a1f4-864ad410f0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:00.205157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a31f9-bc5f-43a4-a1f4-864ad410f0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:00.227108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ec4a31f9-bc5f-43a4-a1f4-864ad410f0f8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:00.228878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ec4a31f9-bc5f-43a4-a1f4-864ad410f0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:00.262530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:00.320049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 74/150] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:00.362588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6edd8-22dd-4659-92ff-0b6a7c45e6e0 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:00.483935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:00.514125 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6edd8-22dd-4659-92ff-0b6a7c45e6e0 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:00.554968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94194e-16e8-4543-94d0-1f48bf5236f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:00.555829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94194e-16e8-4543-94d0-1f48bf5236f3 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:00.556120 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94194e-16e8-4543-94d0-1f48bf5236f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:00.556430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94194e-16e8-4543-94d0-1f48bf5236f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:00.573257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94194e-16e8-4543-94d0-1f48bf5236f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-4b94194e-16e8-4543-94d0-1f48bf5236f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:00.581085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:00.581943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:00.582696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 77/151] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:54:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:00.590390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a31f9-bc5f-43a4-a1f4-864ad410f0f8 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:00.730214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a31f9-bc5f-43a4-a1f4-864ad410f0f8 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:00.766572 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcf26b-c951-49a2-a0ab-55813ff47c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:00.767631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcf26b-c951-49a2-a0ab-55813ff47c81 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:00.768114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcf26b-c951-49a2-a0ab-55813ff47c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:00.768624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcf26b-c951-49a2-a0ab-55813ff47c81 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:00.769576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcf26b-c951-49a2-a0ab-55813ff47c81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:00.770106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcf26b-c951-49a2-a0ab-55813ff47c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:00.771696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcf26b-c951-49a2-a0ab-55813ff47c81 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:00.781353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 75/152] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:00.786590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94194e-16e8-4543-94d0-1f48bf5236f3 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:00.908530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94194e-16e8-4543-94d0-1f48bf5236f3 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:00.931609 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51191a90-ab0c-4b9e-92d0-c3ae4b0a5697 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:00.932417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51191a90-ab0c-4b9e-92d0-c3ae4b0a5697 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:00.932896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51191a90-ab0c-4b9e-92d0-c3ae4b0a5697 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:00.934532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 76/153] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:54:00.940084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14d3c4-84f6-48fe-8676-1463324505cb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:00.940665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14d3c4-84f6-48fe-8676-1463324505cb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:00.941143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14d3c4-84f6-48fe-8676-1463324505cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:00.978039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cc14d3c4-84f6-48fe-8676-1463324505cb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:00.980510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cc14d3c4-84f6-48fe-8676-1463324505cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:01.002650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba718e9-8984-4511-a398-8b629b2407b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:01.003964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba718e9-8984-4511-a398-8b629b2407b7 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:01.004471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba718e9-8984-4511-a398-8b629b2407b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:01.004947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba718e9-8984-4511-a398-8b629b2407b7 None admin] PATH_INFO: `/v3/users/97288f3cd6034b58b6dbfbe8f64b9614` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:01.006630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba718e9-8984-4511-a398-8b629b2407b7 None admin] RBAC: Authorizing `identity:get_user(user_id=97288f3cd6034b58b6dbfbe8f64b9614)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:01.008990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba718e9-8984-4511-a398-8b629b2407b7 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:01.012872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 78/154] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:00 2022] GET /identity/v3/users/97288f3cd6034b58b6dbfbe8f64b9614 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:01.018605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba718e9-8984-4511-a398-8b629b2407b7 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:01.025124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:01.044681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:01.122133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 77/155] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:01.174351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14d3c4-84f6-48fe-8676-1463324505cb None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:01.191822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba718e9-8984-4511-a398-8b629b2407b7 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:01.268218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d23a9-157a-4382-b358-a3bd9e5045d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:01.268972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d23a9-157a-4382-b358-a3bd9e5045d0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:01.269203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d23a9-157a-4382-b358-a3bd9e5045d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:01.269484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d23a9-157a-4382-b358-a3bd9e5045d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:01.304053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14d3c4-84f6-48fe-8676-1463324505cb None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:01.361638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa14079-b3fe-414f-9378-23cb15d261b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:01.362807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14079-b3fe-414f-9378-23cb15d261b3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:01.363288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14079-b3fe-414f-9378-23cb15d261b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:01.363786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14079-b3fe-414f-9378-23cb15d261b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:01.366239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d23a9-157a-4382-b358-a3bd9e5045d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:01.369109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d23a9-157a-4382-b358-a3bd9e5045d0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:01.379834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa14079-b3fe-414f-9378-23cb15d261b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6aa14079-b3fe-414f-9378-23cb15d261b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:01.392959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:01.393986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:01.394816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:01.400696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:01.402188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 78/156] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:01.407365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa14079-b3fe-414f-9378-23cb15d261b3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:01.437660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:01.513090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 79/157] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:01.517297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d23a9-157a-4382-b358-a3bd9e5045d0 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:01.552359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa14079-b3fe-414f-9378-23cb15d261b3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:01.605947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5143fb-845b-4308-8864-a05e73e0c0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:01.607466 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5143fb-845b-4308-8864-a05e73e0c0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:01.607959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5143fb-845b-4308-8864-a05e73e0c0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:01.608488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5143fb-845b-4308-8864-a05e73e0c0b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:01.609447 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5143fb-845b-4308-8864-a05e73e0c0b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:01.609973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5143fb-845b-4308-8864-a05e73e0c0b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:01.611567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5143fb-845b-4308-8864-a05e73e0c0b2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:01.624939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 79/158] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:01.630511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5143fb-845b-4308-8864-a05e73e0c0b2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:01.656281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d23a9-157a-4382-b358-a3bd9e5045d0 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:01.672716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:01.711527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0094c-25ed-4555-8881-7280b7f7a812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:01.716673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0094c-25ed-4555-8881-7280b7f7a812 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:01.716673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0094c-25ed-4555-8881-7280b7f7a812 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:01.716673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0094c-25ed-4555-8881-7280b7f7a812 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:01.717078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0094c-25ed-4555-8881-7280b7f7a812 None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:01.718559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0094c-25ed-4555-8881-7280b7f7a812 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:01.720700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 80/159] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:01 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:01.726171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0094c-25ed-4555-8881-7280b7f7a812 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:01.753210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:01.781222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5143fb-845b-4308-8864-a05e73e0c0b2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:01.832840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7a368-100f-4e0b-9c5a-f1496b65d675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:01.834093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7a368-100f-4e0b-9c5a-f1496b65d675 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:01.834573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7a368-100f-4e0b-9c5a-f1496b65d675 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:01.835054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7a368-100f-4e0b-9c5a-f1496b65d675 None admin] PATH_INFO: `/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:01.840490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7a368-100f-4e0b-9c5a-f1496b65d675 None admin] RBAC: Authorizing `identity:get_user(user_id=73bcdb8c740d442ba5c3dfc9d8df69e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:01.842268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7a368-100f-4e0b-9c5a-f1496b65d675 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:01.844166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 80/160] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:01 2022] GET /identity/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:01.849622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7a368-100f-4e0b-9c5a-f1496b65d675 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:01.874348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0094c-25ed-4555-8881-7280b7f7a812 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:01.930346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d9514-24b5-4a82-8e4e-88cce7c872aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:01.931536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9514-24b5-4a82-8e4e-88cce7c872aa None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:01.931821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9514-24b5-4a82-8e4e-88cce7c872aa None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:01.932098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9514-24b5-4a82-8e4e-88cce7c872aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:01.933000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d9514-24b5-4a82-8e4e-88cce7c872aa None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=352488bb649b45819bed25de31f1156f, user.id=97288f3cd6034b58b6dbfbe8f64b9614) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:01.933277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d9514-24b5-4a82-8e4e-88cce7c872aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:01.934721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d9514-24b5-4a82-8e4e-88cce7c872aa None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:01.953067 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 81/161] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:01 2022] GET /identity/v3/role_assignments?user.id=97288f3cd6034b58b6dbfbe8f64b9614&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:02.005283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7a368-100f-4e0b-9c5a-f1496b65d675 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:02.056416 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851e081-f67f-47ad-908c-78fd3ca2f713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:02.057463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851e081-f67f-47ad-908c-78fd3ca2f713 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:02.057968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851e081-f67f-47ad-908c-78fd3ca2f713 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:02.058460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851e081-f67f-47ad-908c-78fd3ca2f713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:02.092765 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:02.142150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851e081-f67f-47ad-908c-78fd3ca2f713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:02.143645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851e081-f67f-47ad-908c-78fd3ca2f713 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:02.250969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 81/162] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:02.261505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d9514-24b5-4a82-8e4e-88cce7c872aa None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:02.324727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:02.389963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d9514-24b5-4a82-8e4e-88cce7c872aa None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:02.427787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2c08b-754e-4a22-914a-84b940bf035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:02.428695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2c08b-754e-4a22-914a-84b940bf035a None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:02.428977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2c08b-754e-4a22-914a-84b940bf035a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:02.429252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2c08b-754e-4a22-914a-84b940bf035a None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:02.430592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2c08b-754e-4a22-914a-84b940bf035a None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:02.432601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2c08b-754e-4a22-914a-84b940bf035a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:02.434490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 82/163] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:02 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:02.440271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851e081-f67f-47ad-908c-78fd3ca2f713 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:02.456126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042eef7-778f-46c4-a0dd-b106261d998a None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:02.456442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042eef7-778f-46c4-a0dd-b106261d998a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:02.456722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042eef7-778f-46c4-a0dd-b106261d998a None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:02.458437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 83/164] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:02.463372 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318d69-8390-45a6-9c12-f87c0f0f7ed2 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:02.463659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318d69-8390-45a6-9c12-f87c0f0f7ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:02.463940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318d69-8390-45a6-9c12-f87c0f0f7ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:02.492806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-e8318d69-8390-45a6-9c12-f87c0f0f7ed2 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:02.494940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e8318d69-8390-45a6-9c12-f87c0f0f7ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:02.512396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:02.580651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851e081-f67f-47ad-908c-78fd3ca2f713 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:02.641855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b686b-1c1e-4f1d-b2a5-b159cebbee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:02.642467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b686b-1c1e-4f1d-b2a5-b159cebbee7c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:02.643880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b686b-1c1e-4f1d-b2a5-b159cebbee7c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:02.643880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b686b-1c1e-4f1d-b2a5-b159cebbee7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:02.643880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b686b-1c1e-4f1d-b2a5-b159cebbee7c None admin] RBAC: Adding query filter params (role.id=9734fe47b63747daa9141041f1723e55, scope.project.id=352488bb649b45819bed25de31f1156f, user.id=73bcdb8c740d442ba5c3dfc9d8df69e7) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:02.644121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b686b-1c1e-4f1d-b2a5-b159cebbee7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:02.652347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b686b-1c1e-4f1d-b2a5-b159cebbee7c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:02.658882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 84/165] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:02.660470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4f612-904d-49f2-a1e4-bb1648fe659b None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:02.660995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4f612-904d-49f2-a1e4-bb1648fe659b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:02.661475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4f612-904d-49f2-a1e4-bb1648fe659b None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:02.662965 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 85/166] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:02.666478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 82/167] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:02 2022] GET /identity/v3/role_assignments?user.id=73bcdb8c740d442ba5c3dfc9d8df69e7&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=9734fe47b63747daa9141041f1723e55 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:02.668328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832cab0-3d00-4488-80ee-7c2358af3614 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:02.668848 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832cab0-3d00-4488-80ee-7c2358af3614 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:02.669344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832cab0-3d00-4488-80ee-7c2358af3614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:02.695541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-3832cab0-3d00-4488-80ee-7c2358af3614 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:02.697664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3832cab0-3d00-4488-80ee-7c2358af3614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:02.760041 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:02.801759 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b686b-1c1e-4f1d-b2a5-b159cebbee7c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:02.806659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 86/168] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:02.831960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832cab0-3d00-4488-80ee-7c2358af3614 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:02.953273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832cab0-3d00-4488-80ee-7c2358af3614 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:02.990210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c8253-c571-46ca-9059-97583ad5f8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:02.991420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c8253-c571-46ca-9059-97583ad5f8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:02.992044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c8253-c571-46ca-9059-97583ad5f8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:02.992727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c8253-c571-46ca-9059-97583ad5f8e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:03.005362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c8253-c571-46ca-9059-97583ad5f8e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-957c8253-c571-46ca-9059-97583ad5f8e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:03.013867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:03.015081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:03.015864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:03.018671 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 87/169] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:03.026280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c8253-c571-46ca-9059-97583ad5f8e2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:03.086559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b686b-1c1e-4f1d-b2a5-b159cebbee7c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:03.089585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:03.115180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:03.189614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a928c92-c983-4484-8061-b67557b9d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:03.190436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928c92-c983-4484-8061-b67557b9d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:03.190728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928c92-c983-4484-8061-b67557b9d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:03.191013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928c92-c983-4484-8061-b67557b9d9f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:03.223218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a928c92-c983-4484-8061-b67557b9d9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-2a928c92-c983-4484-8061-b67557b9d9f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:03.231852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:03.232757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:03.233528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:03.241181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 83/170] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:54:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:03.247838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c8253-c571-46ca-9059-97583ad5f8e2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:03.253306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a928c92-c983-4484-8061-b67557b9d9f4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:03.310529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f097c-ecd0-4c26-8ed6-c91280db9143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:03.311208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f097c-ecd0-4c26-8ed6-c91280db9143 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:03.311599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f097c-ecd0-4c26-8ed6-c91280db9143 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:03.311880 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f097c-ecd0-4c26-8ed6-c91280db9143 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:03.312785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f097c-ecd0-4c26-8ed6-c91280db9143 None admin] RBAC: Adding query filter params (name=member) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:03.313096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f097c-ecd0-4c26-8ed6-c91280db9143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:03.314479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f097c-ecd0-4c26-8ed6-c91280db9143 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:03.328564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 88/171] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:03.333525 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f097c-ecd0-4c26-8ed6-c91280db9143 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:03.442988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a928c92-c983-4484-8061-b67557b9d9f4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:03.493571 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:03.515699 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f097c-ecd0-4c26-8ed6-c91280db9143 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:03.518030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d07c7-ebc1-4318-9a54-ee9b0d72a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:03.518768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d07c7-ebc1-4318-9a54-ee9b0d72a7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:03.519062 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d07c7-ebc1-4318-9a54-ee9b0d72a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:03.519341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d07c7-ebc1-4318-9a54-ee9b0d72a7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:03.520175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d07c7-ebc1-4318-9a54-ee9b0d72a7b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:03.520513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d07c7-ebc1-4318-9a54-ee9b0d72a7b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:03.521920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d07c7-ebc1-4318-9a54-ee9b0d72a7b4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:03.538844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 84/172] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:03.544498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d07c7-ebc1-4318-9a54-ee9b0d72a7b4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:03.585707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55331fcc-e1d3-4278-b76d-0237dd4353b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:03.587133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55331fcc-e1d3-4278-b76d-0237dd4353b1 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:03.587546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55331fcc-e1d3-4278-b76d-0237dd4353b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:03.587836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55331fcc-e1d3-4278-b76d-0237dd4353b1 None admin] PATH_INFO: `/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:03.593099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55331fcc-e1d3-4278-b76d-0237dd4353b1 None admin] RBAC: Authorizing `identity:get_user(user_id=73bcdb8c740d442ba5c3dfc9d8df69e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:03.594591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55331fcc-e1d3-4278-b76d-0237dd4353b1 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:03.596291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 89/173] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:03 2022] GET /identity/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:03.601665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55331fcc-e1d3-4278-b76d-0237dd4353b1 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:03.616682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:03.712444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d07c7-ebc1-4318-9a54-ee9b0d72a7b4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:03.751847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55331fcc-e1d3-4278-b76d-0237dd4353b1 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:03.786019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5021107-4822-410a-b4a8-587ea888ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:03.786923 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5021107-4822-410a-b4a8-587ea888ef16 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:03.787210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5021107-4822-410a-b4a8-587ea888ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:03.787486 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5021107-4822-410a-b4a8-587ea888ef16 None admin] PATH_INFO: `/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:03.787990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1c47e-2542-4199-96f1-9aa94b9b77d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:03.788826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1c47e-2542-4199-96f1-9aa94b9b77d3 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:03.789273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1c47e-2542-4199-96f1-9aa94b9b77d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:03.789694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1c47e-2542-4199-96f1-9aa94b9b77d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:03.793216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5021107-4822-410a-b4a8-587ea888ef16 None admin] RBAC: Authorizing `identity:get_user(user_id=73bcdb8c740d442ba5c3dfc9d8df69e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:03.795030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5021107-4822-410a-b4a8-587ea888ef16 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:03.796600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 85/174] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:03 2022] GET /identity/v3/users/73bcdb8c740d442ba5c3dfc9d8df69e7 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:03.797860 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f13eef-2c8f-4bf7-b2c4-aab60e06c613 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:03.798151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f13eef-2c8f-4bf7-b2c4-aab60e06c613 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:03.798433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f13eef-2c8f-4bf7-b2c4-aab60e06c613 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:03.799698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 86/175] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:03.805239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d70d-3c61-4407-8590-42623b9ef230 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:03.806095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d70d-3c61-4407-8590-42623b9ef230 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:03.806381 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4d70d-3c61-4407-8590-42623b9ef230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:03.822637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:03.849317 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-10e4d70d-3c61-4407-8590-42623b9ef230 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:03.850545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-10e4d70d-3c61-4407-8590-42623b9ef230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:03.866160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1c47e-2542-4199-96f1-9aa94b9b77d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:03.868579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1c47e-2542-4199-96f1-9aa94b9b77d3 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:03.954811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 87/176] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:03.955651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4d70d-3c61-4407-8590-42623b9ef230 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:03.974507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 90/177] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:54:03.981485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1c47e-2542-4199-96f1-9aa94b9b77d3 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:03.999755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:04.067531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:04.127375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4d70d-3c61-4407-8590-42623b9ef230 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:04.133010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1c47e-2542-4199-96f1-9aa94b9b77d3 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:04.164897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3d059-dfa4-4ce5-a320-25ff4faf560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:04.166067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d059-dfa4-4ce5-a320-25ff4faf560b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.166353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d059-dfa4-4ce5-a320-25ff4faf560b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.166631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d059-dfa4-4ce5-a320-25ff4faf560b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.175867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543891a-85fe-4d24-8df8-ed9dea2c5935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:04.176770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543891a-85fe-4d24-8df8-ed9dea2c5935 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.177049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543891a-85fe-4d24-8df8-ed9dea2c5935 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.177783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543891a-85fe-4d24-8df8-ed9dea2c5935 None admin] PATH_INFO: `/v3/projects/40384cc54e3f4fedae5728aa94fe9e62` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.179390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543891a-85fe-4d24-8df8-ed9dea2c5935 None admin] RBAC: Authorizing `identity:get_project(project_id=40384cc54e3f4fedae5728aa94fe9e62)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:04.181204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543891a-85fe-4d24-8df8-ed9dea2c5935 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:04.188408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 91/178] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:03 2022] GET /identity/v3/projects/40384cc54e3f4fedae5728aa94fe9e62 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:04.189253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543891a-85fe-4d24-8df8-ed9dea2c5935 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:04.253761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3d059-dfa4-4ce5-a320-25ff4faf560b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:04.255237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3d059-dfa4-4ce5-a320-25ff4faf560b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:04.284063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:04.290345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543891a-85fe-4d24-8df8-ed9dea2c5935 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:04.316712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:04.325475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fa4f2-0e1f-43db-93b6-8713acd94d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:04.326208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa4f2-0e1f-43db-93b6-8713acd94d78 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.326498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa4f2-0e1f-43db-93b6-8713acd94d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.326782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa4f2-0e1f-43db-93b6-8713acd94d78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.336735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fa4f2-0e1f-43db-93b6-8713acd94d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-1d6fa4f2-0e1f-43db-93b6-8713acd94d78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:04.344461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:04.345422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:04.346222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 92/179] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:54:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:04.346865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd6e8-0a97-43c1-b7ea-f45919391a4e None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.347127 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd6e8-0a97-43c1-b7ea-f45919391a4e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.347644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd6e8-0a97-43c1-b7ea-f45919391a4e None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.348708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 93/180] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:04.349409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd6e8-0a97-43c1-b7ea-f45919391a4e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:04.358027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 88/181] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:04.359629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5996004-cd52-4fb4-a233-74a917420433 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.359923 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5996004-cd52-4fb4-a233-74a917420433 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.360197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5996004-cd52-4fb4-a233-74a917420433 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.361487 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 89/182] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:04.362900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c65a32-bf46-4cdf-94ba-e8c4f30b4d68 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.363248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c65a32-bf46-4cdf-94ba-e8c4f30b4d68 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.363527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c65a32-bf46-4cdf-94ba-e8c4f30b4d68 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.365207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 90/183] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:04.365503 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c65a32-bf46-4cdf-94ba-e8c4f30b4d68 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:04.449478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd6e8-0a97-43c1-b7ea-f45919391a4e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:04.467316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c65a32-bf46-4cdf-94ba-e8c4f30b4d68 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:04.481881 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b746e-bae0-426d-9df2-970ce7f83f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:04.482529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b746e-bae0-426d-9df2-970ce7f83f84 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.482816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b746e-bae0-426d-9df2-970ce7f83f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.483096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b746e-bae0-426d-9df2-970ce7f83f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.483940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b746e-bae0-426d-9df2-970ce7f83f84 None admin] RBAC: Adding query filter params (role.id=9734fe47b63747daa9141041f1723e55, scope.project.id=40384cc54e3f4fedae5728aa94fe9e62, user.id=73bcdb8c740d442ba5c3dfc9d8df69e7) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:04.484264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b746e-bae0-426d-9df2-970ce7f83f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:04.485743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b746e-bae0-426d-9df2-970ce7f83f84 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:04.500353 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 94/184] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:04 2022] GET /identity/v3/role_assignments?user.id=73bcdb8c740d442ba5c3dfc9d8df69e7&scope.project.id=40384cc54e3f4fedae5728aa94fe9e62&role.id=9734fe47b63747daa9141041f1723e55 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:04.500353 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ecd6-b3d7-4e3e-a21e-25cc54365d46 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.500353 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ecd6-b3d7-4e3e-a21e-25cc54365d46 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.500353 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ecd6-b3d7-4e3e-a21e-25cc54365d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.500771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:04.508448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7a7ae-8cb4-4546-9416-dc1fb739b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:04.508448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7a7ae-8cb4-4546-9416-dc1fb739b54b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.508448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7a7ae-8cb4-4546-9416-dc1fb739b54b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.508448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7a7ae-8cb4-4546-9416-dc1fb739b54b None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.508897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7a7ae-8cb4-4546-9416-dc1fb739b54b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:04.508897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7a7ae-8cb4-4546-9416-dc1fb739b54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:04.508897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7a7ae-8cb4-4546-9416-dc1fb739b54b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:04.510642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b035ecd6-b3d7-4e3e-a21e-25cc54365d46 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:04.511886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b035ecd6-b3d7-4e3e-a21e-25cc54365d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:04.515941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 91/185] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:04.521240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7a7ae-8cb4-4546-9416-dc1fb739b54b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:04.566964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:04.588723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 95/186] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:04.590135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a134b-77e0-4533-87f3-ac2dd98367d9 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.590515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a134b-77e0-4533-87f3-ac2dd98367d9 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.590869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a134b-77e0-4533-87f3-ac2dd98367d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.608641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-325a134b-77e0-4533-87f3-ac2dd98367d9 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:04.609979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-325a134b-77e0-4533-87f3-ac2dd98367d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:04.651407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7a7ae-8cb4-4546-9416-dc1fb739b54b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:04.684448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 96/187] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:04.692543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f1949-0ed9-4908-8f29-ad74cc8545d6 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.692543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f1949-0ed9-4908-8f29-ad74cc8545d6 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.692543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f1949-0ed9-4908-8f29-ad74cc8545d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.692766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7b5ca-dfc6-4a72-871e-bfd46f7f9734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:04.692766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7b5ca-dfc6-4a72-871e-bfd46f7f9734 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.692766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7b5ca-dfc6-4a72-871e-bfd46f7f9734 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.692766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7b5ca-dfc6-4a72-871e-bfd46f7f9734 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.693049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7b5ca-dfc6-4a72-871e-bfd46f7f9734 None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:04.696636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7b5ca-dfc6-4a72-871e-bfd46f7f9734 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:04.697868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 92/188] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:04 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:04.698736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7b5ca-dfc6-4a72-871e-bfd46f7f9734 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:04.704459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b08f1949-0ed9-4908-8f29-ad74cc8545d6 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:04.705657 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b08f1949-0ed9-4908-8f29-ad74cc8545d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:04.762629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:04.782203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 97/189] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:04.783270 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f1949-0ed9-4908-8f29-ad74cc8545d6 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:04.814342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7b5ca-dfc6-4a72-871e-bfd46f7f9734 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:04.826526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:04.847531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cd405-1111-4da8-931d-039becc726dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:04.848692 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cd405-1111-4da8-931d-039becc726dd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.848975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cd405-1111-4da8-931d-039becc726dd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.849250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cd405-1111-4da8-931d-039becc726dd None admin] PATH_INFO: `/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.862917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cd405-1111-4da8-931d-039becc726dd None admin] RBAC: Authorizing `identity:get_user(user_id=dbf6092b3d6f436fad8fe6ce639d3f83)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:04.864420 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cd405-1111-4da8-931d-039becc726dd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:04.866101 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 93/190] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:04 2022] GET /identity/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:04.869133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cd405-1111-4da8-931d-039becc726dd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:04.882577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f1949-0ed9-4908-8f29-ad74cc8545d6 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:04.916236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d0d8c-fe92-4e5b-82ff-35a3ae4d03f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:04.917053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d0d8c-fe92-4e5b-82ff-35a3ae4d03f4 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:04.917340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d0d8c-fe92-4e5b-82ff-35a3ae4d03f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:04.917618 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d0d8c-fe92-4e5b-82ff-35a3ae4d03f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:04.927594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d0d8c-fe92-4e5b-82ff-35a3ae4d03f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-475d0d8c-fe92-4e5b-82ff-35a3ae4d03f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:04.935444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:04.936561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 98/191] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:04.937831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d0d8c-fe92-4e5b-82ff-35a3ae4d03f4 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:04.969267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cd405-1111-4da8-931d-039becc726dd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:04.986195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:05.003839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0387e-1c45-413e-9d35-fcab0fdc7066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.004554 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0387e-1c45-413e-9d35-fcab0fdc7066 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.004839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0387e-1c45-413e-9d35-fcab0fdc7066 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.005110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0387e-1c45-413e-9d35-fcab0fdc7066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.005948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0387e-1c45-413e-9d35-fcab0fdc7066 None admin] RBAC: Adding query filter params (role.id=5cdb558ab7044154896c8f9e3dfba431, scope.project.id=352488bb649b45819bed25de31f1156f, user.id=73bcdb8c740d442ba5c3dfc9d8df69e7) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:05.006258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0387e-1c45-413e-9d35-fcab0fdc7066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:05.007700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0387e-1c45-413e-9d35-fcab0fdc7066 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:05.014423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 94/192] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:04 2022] GET /identity/v3/role_assignments?user.id=73bcdb8c740d442ba5c3dfc9d8df69e7&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=5cdb558ab7044154896c8f9e3dfba431 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:05.015234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0387e-1c45-413e-9d35-fcab0fdc7066 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:05.057525 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d0d8c-fe92-4e5b-82ff-35a3ae4d03f4 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:05.059161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:05.097475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8587f20-0519-4879-bbb6-c1602e413c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.098376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8587f20-0519-4879-bbb6-c1602e413c3a None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.098598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8587f20-0519-4879-bbb6-c1602e413c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.098874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8587f20-0519-4879-bbb6-c1602e413c3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.110223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8587f20-0519-4879-bbb6-c1602e413c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-c8587f20-0519-4879-bbb6-c1602e413c3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:05.118975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:05.119854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 99/193] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:54:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:05.125526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8587f20-0519-4879-bbb6-c1602e413c3a None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:05.139587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0387e-1c45-413e-9d35-fcab0fdc7066 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:05.186130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434254a7-905f-44f1-8ead-8d459097a5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.187117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434254a7-905f-44f1-8ead-8d459097a5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.187599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434254a7-905f-44f1-8ead-8d459097a5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.187713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434254a7-905f-44f1-8ead-8d459097a5c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.188857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434254a7-905f-44f1-8ead-8d459097a5c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:05.190499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434254a7-905f-44f1-8ead-8d459097a5c9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:05.192164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 95/194] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:05.192702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434254a7-905f-44f1-8ead-8d459097a5c9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:05.236829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8587f20-0519-4879-bbb6-c1602e413c3a None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:05.253121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:05.273394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe8eb0-5060-4a6a-8f8f-184abd3a6bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.274042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe8eb0-5060-4a6a-8f8f-184abd3a6bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.274399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe8eb0-5060-4a6a-8f8f-184abd3a6bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.274681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe8eb0-5060-4a6a-8f8f-184abd3a6bd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.304272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:05.304754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434254a7-905f-44f1-8ead-8d459097a5c9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:05.337371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed3a30-82d1-4a88-8999-c4fe15f9308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.338034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed3a30-82d1-4a88-8999-c4fe15f9308e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.338322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed3a30-82d1-4a88-8999-c4fe15f9308e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.338612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed3a30-82d1-4a88-8999-c4fe15f9308e None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.339358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed3a30-82d1-4a88-8999-c4fe15f9308e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:05.339674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed3a30-82d1-4a88-8999-c4fe15f9308e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:05.341087 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed3a30-82d1-4a88-8999-c4fe15f9308e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:05.341711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe8eb0-5060-4a6a-8f8f-184abd3a6bd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:05.343188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe8eb0-5060-4a6a-8f8f-184abd3a6bd0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:05.350051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 96/195] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:05.351195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed3a30-82d1-4a88-8999-c4fe15f9308e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:05.437584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 100/196] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:05.438469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe8eb0-5060-4a6a-8f8f-184abd3a6bd0 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:05.449930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed3a30-82d1-4a88-8999-c4fe15f9308e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:05.462497 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:05.483848 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf5d7-e327-4d79-a69a-2c7e2837b74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.484527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf5d7-e327-4d79-a69a-2c7e2837b74c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.484808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf5d7-e327-4d79-a69a-2c7e2837b74c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.485081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaf5d7-e327-4d79-a69a-2c7e2837b74c None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.485818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaf5d7-e327-4d79-a69a-2c7e2837b74c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:05.486123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaf5d7-e327-4d79-a69a-2c7e2837b74c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:05.487486 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaf5d7-e327-4d79-a69a-2c7e2837b74c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:05.495775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 97/197] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:05.496579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf5d7-e327-4d79-a69a-2c7e2837b74c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:05.502342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:05.543092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe8eb0-5060-4a6a-8f8f-184abd3a6bd0 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:05.574946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbad330-3df5-4ed8-9dcf-552782654330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.575606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbad330-3df5-4ed8-9dcf-552782654330 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.575895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbad330-3df5-4ed8-9dcf-552782654330 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.576181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbad330-3df5-4ed8-9dcf-552782654330 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.576920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbad330-3df5-4ed8-9dcf-552782654330 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:05.578381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbad330-3df5-4ed8-9dcf-552782654330 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:05.594048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaf5d7-e327-4d79-a69a-2c7e2837b74c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:05.597888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 101/198] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:54:05 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:54:05.598687 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbad330-3df5-4ed8-9dcf-552782654330 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:05.638801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559199c-8d4c-4d7e-9c97-c49b508b06af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.639722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559199c-8d4c-4d7e-9c97-c49b508b06af None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.640006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559199c-8d4c-4d7e-9c97-c49b508b06af None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.640284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559199c-8d4c-4d7e-9c97-c49b508b06af None admin] PATH_INFO: `/v3/users/6da373495612459eaeec3853d99a61c6` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.641586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559199c-8d4c-4d7e-9c97-c49b508b06af None admin] RBAC: Authorizing `identity:get_user(user_id=6da373495612459eaeec3853d99a61c6)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:05.643072 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559199c-8d4c-4d7e-9c97-c49b508b06af None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:05.645004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 98/199] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:05 2022] GET /identity/v3/users/6da373495612459eaeec3853d99a61c6 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:05.645700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559199c-8d4c-4d7e-9c97-c49b508b06af None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:05.692937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:05.716354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbad330-3df5-4ed8-9dcf-552782654330 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:05.734683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:05.757669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf908d-4fa7-4ebc-9508-2a9f972e72bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.759103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf908d-4fa7-4ebc-9508-2a9f972e72bb None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.759336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559199c-8d4c-4d7e-9c97-c49b508b06af None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:05.759436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf908d-4fa7-4ebc-9508-2a9f972e72bb None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.759645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf908d-4fa7-4ebc-9508-2a9f972e72bb None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.761006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf908d-4fa7-4ebc-9508-2a9f972e72bb None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:05.762526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf908d-4fa7-4ebc-9508-2a9f972e72bb None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:05.764380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 102/200] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:05 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:05.765037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf908d-4fa7-4ebc-9508-2a9f972e72bb None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:05.799123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308b402-dafd-4b60-a978-0efe95e204dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.800002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b402-dafd-4b60-a978-0efe95e204dc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.800280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b402-dafd-4b60-a978-0efe95e204dc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.800585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308b402-dafd-4b60-a978-0efe95e204dc None admin] PATH_INFO: `/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.801788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308b402-dafd-4b60-a978-0efe95e204dc None admin] RBAC: Authorizing `identity:get_user(user_id=dbf6092b3d6f436fad8fe6ce639d3f83)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:05.803336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308b402-dafd-4b60-a978-0efe95e204dc None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:05.806264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 99/201] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:05 2022] GET /identity/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:05.806264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308b402-dafd-4b60-a978-0efe95e204dc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:05.890587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf908d-4fa7-4ebc-9508-2a9f972e72bb None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:05.932078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308b402-dafd-4b60-a978-0efe95e204dc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:05.933929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278fb8b-7537-4555-994f-de7acb432eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.934688 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278fb8b-7537-4555-994f-de7acb432eda None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.934972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278fb8b-7537-4555-994f-de7acb432eda None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.935256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278fb8b-7537-4555-994f-de7acb432eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.944778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:05.973545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b0534-2660-4e11-84a3-78728120c97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:05.974229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b0534-2660-4e11-84a3-78728120c97e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:05.974516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b0534-2660-4e11-84a3-78728120c97e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:05.974791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b0534-2660-4e11-84a3-78728120c97e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:05.975637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b0534-2660-4e11-84a3-78728120c97e None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b, user.id=dbf6092b3d6f436fad8fe6ce639d3f83) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:05.975937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b0534-2660-4e11-84a3-78728120c97e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:05.977989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b0534-2660-4e11-84a3-78728120c97e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:05.983640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 100/202] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:05 2022] GET /identity/v3/role_assignments?user.id=dbf6092b3d6f436fad8fe6ce639d3f83&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:05.988580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b0534-2660-4e11-84a3-78728120c97e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:06.027166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:06.056026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278fb8b-7537-4555-994f-de7acb432eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:06.059650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278fb8b-7537-4555-994f-de7acb432eda None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:06.201277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b0534-2660-4e11-84a3-78728120c97e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:06.268398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 103/203] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:06.270886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e5889-725e-4e2c-90d8-978f91981947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:06.271542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e5889-725e-4e2c-90d8-978f91981947 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:06.271825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e5889-725e-4e2c-90d8-978f91981947 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:06.272103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e5889-725e-4e2c-90d8-978f91981947 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:06.275335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278fb8b-7537-4555-994f-de7acb432eda None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:06.354959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:06.400046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e5889-725e-4e2c-90d8-978f91981947 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:06.405850 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e5889-725e-4e2c-90d8-978f91981947 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:06.428358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:06.458413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278fb8b-7537-4555-994f-de7acb432eda None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:06.527906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e1d2a-aaa5-40f3-852f-be4c949e9c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:06.528804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e1d2a-aaa5-40f3-852f-be4c949e9c1f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:06.529084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e1d2a-aaa5-40f3-852f-be4c949e9c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:06.529360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e1d2a-aaa5-40f3-852f-be4c949e9c1f None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:06.531812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e1d2a-aaa5-40f3-852f-be4c949e9c1f None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:06.533306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e1d2a-aaa5-40f3-852f-be4c949e9c1f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:06.535024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 104/204] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:06 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:06.549689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e1d2a-aaa5-40f3-852f-be4c949e9c1f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:06.596450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 101/205] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:06.605257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e5889-725e-4e2c-90d8-978f91981947 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:06.679794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e1d2a-aaa5-40f3-852f-be4c949e9c1f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:06.718497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5746dff-ae7a-4bb6-81e4-1a17b23e48c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:06.719430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746dff-ae7a-4bb6-81e4-1a17b23e48c3 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:06.719788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746dff-ae7a-4bb6-81e4-1a17b23e48c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:06.720159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5746dff-ae7a-4bb6-81e4-1a17b23e48c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:06.721097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5746dff-ae7a-4bb6-81e4-1a17b23e48c3 None admin] RBAC: Adding query filter params (role.id=89ec31929ee14f1a94fa3a1f8cbd9438, scope.project.id=352488bb649b45819bed25de31f1156f, user.id=6da373495612459eaeec3853d99a61c6) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:06.721478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5746dff-ae7a-4bb6-81e4-1a17b23e48c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:06.723002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5746dff-ae7a-4bb6-81e4-1a17b23e48c3 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:06.730825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 105/206] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:06 2022] GET /identity/v3/role_assignments?user.id=6da373495612459eaeec3853d99a61c6&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=89ec31929ee14f1a94fa3a1f8cbd9438 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:06.792203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:06.834817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e5889-725e-4e2c-90d8-978f91981947 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:06.881596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ff8b1-7881-40ef-a544-a9e31683b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:06.882447 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff8b1-7881-40ef-a544-a9e31683b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:06.882723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff8b1-7881-40ef-a544-a9e31683b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:06.882990 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff8b1-7881-40ef-a544-a9e31683b1b1 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:06.889157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ff8b1-7881-40ef-a544-a9e31683b1b1 None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:06.890657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ff8b1-7881-40ef-a544-a9e31683b1b1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:06.892821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 102/207] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:06 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:06.898310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5746dff-ae7a-4bb6-81e4-1a17b23e48c3 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:06.922590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:07.017213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5746dff-ae7a-4bb6-81e4-1a17b23e48c3 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:07.056390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2655d8b-748c-4670-8d2d-afaf4eb8cf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:07.057080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2655d8b-748c-4670-8d2d-afaf4eb8cf5b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:07.057363 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2655d8b-748c-4670-8d2d-afaf4eb8cf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:07.057637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2655d8b-748c-4670-8d2d-afaf4eb8cf5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:07.058507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2655d8b-748c-4670-8d2d-afaf4eb8cf5b None admin] RBAC: Adding query filter params (role.id=5cdb558ab7044154896c8f9e3dfba431, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b, user.id=dbf6092b3d6f436fad8fe6ce639d3f83) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:07.058826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2655d8b-748c-4670-8d2d-afaf4eb8cf5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:07.060370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2655d8b-748c-4670-8d2d-afaf4eb8cf5b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:07.067261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 106/208] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:06 2022] GET /identity/v3/role_assignments?user.id=dbf6092b3d6f436fad8fe6ce639d3f83&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=5cdb558ab7044154896c8f9e3dfba431 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:07.961308 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13609-7c25-423a-9e82-07da0e11dcbf None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:07.963003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13609-7c25-423a-9e82-07da0e11dcbf None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:07.963513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13609-7c25-423a-9e82-07da0e11dcbf None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:07.965368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 103/209] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:07.971196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0be433-af54-4b5a-9ae4-25b27a91bbbf None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:07.971723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0be433-af54-4b5a-9ae4-25b27a91bbbf None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:07.972205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0be433-af54-4b5a-9ae4-25b27a91bbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:07.990250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-bf0be433-af54-4b5a-9ae4-25b27a91bbbf None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:07.991782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-bf0be433-af54-4b5a-9ae4-25b27a91bbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:08.026262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12071c7-f492-454b-b7ac-a43ca7a7e9c4 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.026566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12071c7-f492-454b-b7ac-a43ca7a7e9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.026816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12071c7-f492-454b-b7ac-a43ca7a7e9c4 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.028361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 104/210] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:54:08.033133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbeae9-8386-45db-840f-9d55832404b0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.033426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbeae9-8386-45db-840f-9d55832404b0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.033705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbeae9-8386-45db-840f-9d55832404b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.050257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-92bbeae9-8386-45db-840f-9d55832404b0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:08.051567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-92bbeae9-8386-45db-840f-9d55832404b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:08.062071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 107/211] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:08.086392 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0be433-af54-4b5a-9ae4-25b27a91bbbf None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:08.103742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:08.127091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 105/212] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:08.128458 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf5c39-d695-4684-9c19-fd0b687b5186 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.128753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf5c39-d695-4684-9c19-fd0b687b5186 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.129031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf5c39-d695-4684-9c19-fd0b687b5186 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.130735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 106/213] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:08.138413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3226f-1bd1-47f6-a760-307eae3c9854 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.138698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3226f-1bd1-47f6-a760-307eae3c9854 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.138971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3226f-1bd1-47f6-a760-307eae3c9854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.159091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6ee3226f-1bd1-47f6-a760-307eae3c9854 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:08.160263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6ee3226f-1bd1-47f6-a760-307eae3c9854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:08.206226 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0be433-af54-4b5a-9ae4-25b27a91bbbf None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:08.235524 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 107/214] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:08.235524 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3226f-1bd1-47f6-a760-307eae3c9854 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:08.248660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:08.257627 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f734-17dc-4349-b42e-2499b48331f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:08.258964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f734-17dc-4349-b42e-2499b48331f6 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.259251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f734-17dc-4349-b42e-2499b48331f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.259527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f734-17dc-4349-b42e-2499b48331f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.270423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4f734-17dc-4349-b42e-2499b48331f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-0bf4f734-17dc-4349-b42e-2499b48331f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:08.278940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:08.279805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:08.280939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 108/215] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:08.281579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f734-17dc-4349-b42e-2499b48331f6 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:08.346864 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3226f-1bd1-47f6-a760-307eae3c9854 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:08.359258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:08.383152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6fe08-e50f-4f54-955e-b5e8183f27b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:08.384508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6fe08-e50f-4f54-955e-b5e8183f27b7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.384789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6fe08-e50f-4f54-955e-b5e8183f27b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.385061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6fe08-e50f-4f54-955e-b5e8183f27b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.386217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6fe08-e50f-4f54-955e-b5e8183f27b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:08.387659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6fe08-e50f-4f54-955e-b5e8183f27b7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:08.392354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 108/216] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:08.392354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6fe08-e50f-4f54-955e-b5e8183f27b7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:08.394597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f734-17dc-4349-b42e-2499b48331f6 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:08.430862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeda4e5-21ee-456e-aa56-18164a96d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:08.431660 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeda4e5-21ee-456e-aa56-18164a96d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.431948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeda4e5-21ee-456e-aa56-18164a96d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.432230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeda4e5-21ee-456e-aa56-18164a96d0b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.442793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeda4e5-21ee-456e-aa56-18164a96d0b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-0aeda4e5-21ee-456e-aa56-18164a96d0b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:08.450973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:08.451860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:08.452694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 109/217] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:54:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:08.453338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeda4e5-21ee-456e-aa56-18164a96d0b9 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:08.467909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:08.500436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6fe08-e50f-4f54-955e-b5e8183f27b7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:08.538265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaf021-8c60-4ae2-ba2f-ad04ea5c8f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:08.539046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaf021-8c60-4ae2-ba2f-ad04ea5c8f41 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.539325 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaf021-8c60-4ae2-ba2f-ad04ea5c8f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.539634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaf021-8c60-4ae2-ba2f-ad04ea5c8f41 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.540397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaf021-8c60-4ae2-ba2f-ad04ea5c8f41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:08.540708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaf021-8c60-4ae2-ba2f-ad04ea5c8f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:08.542331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaf021-8c60-4ae2-ba2f-ad04ea5c8f41 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:08.555945 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 109/218] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:08.555945 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaf021-8c60-4ae2-ba2f-ad04ea5c8f41 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:08.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeda4e5-21ee-456e-aa56-18164a96d0b9 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:08.592123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:08.598198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01d755-b992-4b75-bff4-e983b647899c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:08.599016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01d755-b992-4b75-bff4-e983b647899c None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.599302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01d755-b992-4b75-bff4-e983b647899c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.599584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01d755-b992-4b75-bff4-e983b647899c None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.600387 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01d755-b992-4b75-bff4-e983b647899c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:08.602090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01d755-b992-4b75-bff4-e983b647899c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:08.625121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 110/219] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:54:08 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:54:08.634026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01d755-b992-4b75-bff4-e983b647899c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:08.664755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaf021-8c60-4ae2-ba2f-ad04ea5c8f41 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:08.704713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:08.707389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fe09d-cf6c-4cac-acc8-ecd80c9beaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:08.708560 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fe09d-cf6c-4cac-acc8-ecd80c9beaaa None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.708951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fe09d-cf6c-4cac-acc8-ecd80c9beaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.709395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fe09d-cf6c-4cac-acc8-ecd80c9beaaa None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.710304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fe09d-cf6c-4cac-acc8-ecd80c9beaaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:08.710715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fe09d-cf6c-4cac-acc8-ecd80c9beaaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:08.712715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fe09d-cf6c-4cac-acc8-ecd80c9beaaa None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:08.725705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 110/220] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:08.731153 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fe09d-cf6c-4cac-acc8-ecd80c9beaaa None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:08.759249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01d755-b992-4b75-bff4-e983b647899c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:08.801236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d60f9-2e0e-4c06-b8e6-0dbb1825b0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:08.802129 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d60f9-2e0e-4c06-b8e6-0dbb1825b0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.802629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d60f9-2e0e-4c06-b8e6-0dbb1825b0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.802752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d60f9-2e0e-4c06-b8e6-0dbb1825b0b6 None admin] PATH_INFO: `/v3/users/84f42fedddac4c0db53e48f41497c5ef` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.823018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d60f9-2e0e-4c06-b8e6-0dbb1825b0b6 None admin] RBAC: Authorizing `identity:get_user(user_id=84f42fedddac4c0db53e48f41497c5ef)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:08.824844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d60f9-2e0e-4c06-b8e6-0dbb1825b0b6 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:08.827175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 111/221] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:08 2022] GET /identity/v3/users/84f42fedddac4c0db53e48f41497c5ef => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:08.832576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d60f9-2e0e-4c06-b8e6-0dbb1825b0b6 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:08.855647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fe09d-cf6c-4cac-acc8-ecd80c9beaaa None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:08.894838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:08.906733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e2752-a502-407e-8951-132186af6f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:08.907861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2752-a502-407e-8951-132186af6f5f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.908330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2752-a502-407e-8951-132186af6f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.908771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2752-a502-407e-8951-132186af6f5f None admin] PATH_INFO: `/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:08.910887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e2752-a502-407e-8951-132186af6f5f None admin] RBAC: Authorizing `identity:get_user(user_id=dbf6092b3d6f436fad8fe6ce639d3f83)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:08.912513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e2752-a502-407e-8951-132186af6f5f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:08.914317 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 111/222] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:08 2022] GET /identity/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:08.921372 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e2752-a502-407e-8951-132186af6f5f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:08.958380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d60f9-2e0e-4c06-b8e6-0dbb1825b0b6 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:08.997038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0080b5-22db-4ebf-8e1d-b403fd0da775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:08.997939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0080b5-22db-4ebf-8e1d-b403fd0da775 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:08.998222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0080b5-22db-4ebf-8e1d-b403fd0da775 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:08.998496 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0080b5-22db-4ebf-8e1d-b403fd0da775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:09.007621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:09.066931 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e2752-a502-407e-8951-132186af6f5f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:09.087667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0080b5-22db-4ebf-8e1d-b403fd0da775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:09.089191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0080b5-22db-4ebf-8e1d-b403fd0da775 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:09.110343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ace31-16a4-4106-8175-20b75cb4e070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:09.111411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ace31-16a4-4106-8175-20b75cb4e070 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:09.111938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ace31-16a4-4106-8175-20b75cb4e070 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:09.112329 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ace31-16a4-4106-8175-20b75cb4e070 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:09.113657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ace31-16a4-4106-8175-20b75cb4e070 None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:09.115208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ace31-16a4-4106-8175-20b75cb4e070 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:09.123552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 112/223] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:08 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:09.125874 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ace31-16a4-4106-8175-20b75cb4e070 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:09.161983 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:09.251931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 112/224] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:54:09.251931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebcee1-4e6a-4d40-9e85-496fa3b9e581 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:09.251931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebcee1-4e6a-4d40-9e85-496fa3b9e581 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:09.251931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebcee1-4e6a-4d40-9e85-496fa3b9e581 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:09.251931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 113/225] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:09.251931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebcee1-4e6a-4d40-9e85-496fa3b9e581 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:09.293020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ace31-16a4-4106-8175-20b75cb4e070 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:09.328666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:09.336227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ca536-7534-489a-89f2-0845ab482589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:09.337623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca536-7534-489a-89f2-0845ab482589 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:09.338166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca536-7534-489a-89f2-0845ab482589 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:09.338689 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca536-7534-489a-89f2-0845ab482589 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/users/dbf6092b3d6f436fad8fe6ce639d3f83/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:09.341056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ca536-7534-489a-89f2-0845ab482589 None admin] RBAC: Authorizing `identity:create_grant(project_id=7761a3e3dfee4860bce7efebb2025a4b, user_id=dbf6092b3d6f436fad8fe6ce639d3f83, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:09.342750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ca536-7534-489a-89f2-0845ab482589 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:09.360653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 113/226] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:54:09 2022] PUT /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/users/dbf6092b3d6f436fad8fe6ce639d3f83/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:54:09.362690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c72e6-a726-477d-8a2d-8b1f26170219 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:09.363188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c72e6-a726-477d-8a2d-8b1f26170219 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:09.363690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c72e6-a726-477d-8a2d-8b1f26170219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:09.396148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9c1c72e6-a726-477d-8a2d-8b1f26170219 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:09.398222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9c1c72e6-a726-477d-8a2d-8b1f26170219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:09.430890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebcee1-4e6a-4d40-9e85-496fa3b9e581 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:09.495183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 114/227] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:09.499130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c1273-f54b-43bc-9441-c8b317301c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:09.500348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c1273-f54b-43bc-9441-c8b317301c6f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:09.500650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c1273-f54b-43bc-9441-c8b317301c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:09.500993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c1273-f54b-43bc-9441-c8b317301c6f None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:09.502362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c1273-f54b-43bc-9441-c8b317301c6f None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:09.503852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c1273-f54b-43bc-9441-c8b317301c6f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:09.505779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 114/228] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:09 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:09.514570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c72e6-a726-477d-8a2d-8b1f26170219 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:09.520703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c1273-f54b-43bc-9441-c8b317301c6f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:09.564806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:09.669517 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c1273-f54b-43bc-9441-c8b317301c6f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:09.673621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c72e6-a726-477d-8a2d-8b1f26170219 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:09.708158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b1002-c866-4931-9eb1-d6dd6defdfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:09.709209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b1002-c866-4931-9eb1-d6dd6defdfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:09.709394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b1002-c866-4931-9eb1-d6dd6defdfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:09.709528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b1002-c866-4931-9eb1-d6dd6defdfc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:09.720217 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b1002-c866-4931-9eb1-d6dd6defdfc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:09.722160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed93b47-7775-451b-b6ea-e26850cc48a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:09.723098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed93b47-7775-451b-b6ea-e26850cc48a5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:09.723581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed93b47-7775-451b-b6ea-e26850cc48a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:09.724086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed93b47-7775-451b-b6ea-e26850cc48a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:09.725165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed93b47-7775-451b-b6ea-e26850cc48a5 None admin] RBAC: Adding query filter params (role.id=9734fe47b63747daa9141041f1723e55, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b, user.id=84f42fedddac4c0db53e48f41497c5ef) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:09.725676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed93b47-7775-451b-b6ea-e26850cc48a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:09.727872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed93b47-7775-451b-b6ea-e26850cc48a5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-ea4b1002-c866-4931-9eb1-d6dd6defdfc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:09.728926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:09.729823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:09.730653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 115/229] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:54:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:09.737585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 115/230] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:09 2022] GET /identity/v3/role_assignments?user.id=84f42fedddac4c0db53e48f41497c5ef&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=9734fe47b63747daa9141041f1723e55 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:09.740682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:09.741955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b1002-c866-4931-9eb1-d6dd6defdfc0 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:09.825109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:09.862539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b1002-c866-4931-9eb1-d6dd6defdfc0 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:09.905565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd437a5d-8c21-49c2-990e-0dca4242eb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:09.906247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd437a5d-8c21-49c2-990e-0dca4242eb0b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:09.906535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd437a5d-8c21-49c2-990e-0dca4242eb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:09.906817 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd437a5d-8c21-49c2-990e-0dca4242eb0b None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:09.907589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd437a5d-8c21-49c2-990e-0dca4242eb0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:09.907902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd437a5d-8c21-49c2-990e-0dca4242eb0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:09.909342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd437a5d-8c21-49c2-990e-0dca4242eb0b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:09.924169 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 116/231] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:09.930770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed93b47-7775-451b-b6ea-e26850cc48a5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:10.059214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed93b47-7775-451b-b6ea-e26850cc48a5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:10.096329 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58bda7-d561-4df2-a072-b7e764ee7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:10.097273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58bda7-d561-4df2-a072-b7e764ee7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:10.097562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58bda7-d561-4df2-a072-b7e764ee7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:10.097839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58bda7-d561-4df2-a072-b7e764ee7ea6 None admin] PATH_INFO: `/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:10.099108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58bda7-d561-4df2-a072-b7e764ee7ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf6092b3d6f436fad8fe6ce639d3f83)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:10.100602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58bda7-d561-4df2-a072-b7e764ee7ea6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:10.102368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 116/232] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:09 2022] GET /identity/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:10.109493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd437a5d-8c21-49c2-990e-0dca4242eb0b None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:10.227627 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd437a5d-8c21-49c2-990e-0dca4242eb0b None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:10.270692 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34809e0-a591-4b03-8a8d-d816bf555d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:10.271561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34809e0-a591-4b03-8a8d-d816bf555d80 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:10.271844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34809e0-a591-4b03-8a8d-d816bf555d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:10.272119 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34809e0-a591-4b03-8a8d-d816bf555d80 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:10.273347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34809e0-a591-4b03-8a8d-d816bf555d80 None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:10.275341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34809e0-a591-4b03-8a8d-d816bf555d80 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:10.277657 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 117/233] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:10 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:10.285358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58bda7-d561-4df2-a072-b7e764ee7ea6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:10.343123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:10.392872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58bda7-d561-4df2-a072-b7e764ee7ea6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:10.427823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cb700-9c16-41fb-931d-98281708856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:10.428744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cb700-9c16-41fb-931d-98281708856a None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:10.429029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cb700-9c16-41fb-931d-98281708856a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:10.429304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cb700-9c16-41fb-931d-98281708856a None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/users/dbf6092b3d6f436fad8fe6ce639d3f83/roles/5cdb558ab7044154896c8f9e3dfba431` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:10.432736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cb700-9c16-41fb-931d-98281708856a None admin] RBAC: Authorizing `identity:create_grant(project_id=7761a3e3dfee4860bce7efebb2025a4b, user_id=dbf6092b3d6f436fad8fe6ce639d3f83, role_id=5cdb558ab7044154896c8f9e3dfba431)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:10.434246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cb700-9c16-41fb-931d-98281708856a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:10.451483 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 117/234] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:54:10 2022] PUT /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/users/dbf6092b3d6f436fad8fe6ce639d3f83/roles/5cdb558ab7044154896c8f9e3dfba431 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:54:11.234532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40e27-047f-46db-b962-4e9870c554b6 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:11.235048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40e27-047f-46db-b962-4e9870c554b6 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:11.235365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b40e27-047f-46db-b962-4e9870c554b6 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:11.239153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 118/235] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:11.249948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466d56-ba2d-4996-bc1f-6c247f8c09d6 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:11.250831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466d56-ba2d-4996-bc1f-6c247f8c09d6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:11.251307 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466d56-ba2d-4996-bc1f-6c247f8c09d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:11.271299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e6466d56-ba2d-4996-bc1f-6c247f8c09d6 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:11.272814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e6466d56-ba2d-4996-bc1f-6c247f8c09d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:11.367947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 118/236] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:11.403525 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b40e27-047f-46db-b962-4e9870c554b6 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:11.413453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:11.423349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd45aed-14e9-44d0-ada9-f5f5691bc67e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:11.423940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd45aed-14e9-44d0-ada9-f5f5691bc67e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:11.424445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd45aed-14e9-44d0-ada9-f5f5691bc67e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:11.426284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 119/237] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:11.438117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48134-5ca9-410e-a683-b65a558bef66 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:11.438704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48134-5ca9-410e-a683-b65a558bef66 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:11.439285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48134-5ca9-410e-a683-b65a558bef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:11.462431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7ef48134-5ca9-410e-a683-b65a558bef66 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:11.463935 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7ef48134-5ca9-410e-a683-b65a558bef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:11.524906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:11.583226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 120/238] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:11.584789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b40e27-047f-46db-b962-4e9870c554b6 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:11.618211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a3ba-d3d3-493c-832f-2518a514fc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:11.619006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a3ba-d3d3-493c-832f-2518a514fc5c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:11.619291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a3ba-d3d3-493c-832f-2518a514fc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:11.619569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4a3ba-d3d3-493c-832f-2518a514fc5c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:11.630145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4a3ba-d3d3-493c-832f-2518a514fc5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-21c4a3ba-d3d3-493c-832f-2518a514fc5c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:11.639519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:11.640813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:11.641604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:11.642254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef48134-5ca9-410e-a683-b65a558bef66 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:11.646488 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 119/239] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:11.652821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a3ba-d3d3-493c-832f-2518a514fc5c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:11.776759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:11.811353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef48134-5ca9-410e-a683-b65a558bef66 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:11.829574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4a3ba-d3d3-493c-832f-2518a514fc5c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:11.873517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2066e91-fea3-4f02-9326-850672530048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:11.874317 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2066e91-fea3-4f02-9326-850672530048 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:11.874600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2066e91-fea3-4f02-9326-850672530048 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:11.874876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2066e91-fea3-4f02-9326-850672530048 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:11.876160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2066e91-fea3-4f02-9326-850672530048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:11.877663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2066e91-fea3-4f02-9326-850672530048 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:11.881379 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 121/240] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:11.886159 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2066e91-fea3-4f02-9326-850672530048 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:11.889383 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1ad23-6d2b-43fe-8715-fbde786aa19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:11.890058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1ad23-6d2b-43fe-8715-fbde786aa19e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:11.890346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1ad23-6d2b-43fe-8715-fbde786aa19e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:11.890621 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1ad23-6d2b-43fe-8715-fbde786aa19e None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:11.891383 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1ad23-6d2b-43fe-8715-fbde786aa19e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:11.891697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1ad23-6d2b-43fe-8715-fbde786aa19e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:11.894680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1ad23-6d2b-43fe-8715-fbde786aa19e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:11.906256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 120/241] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:11.907679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e27d-5f5c-4df4-beb3-9cdf74958967 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:11.907978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e27d-5f5c-4df4-beb3-9cdf74958967 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:11.908256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e27d-5f5c-4df4-beb3-9cdf74958967 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:11.909552 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 121/242] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:11.911444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5e27d-5f5c-4df4-beb3-9cdf74958967 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:11.942737 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:12.018332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2066e91-fea3-4f02-9326-850672530048 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:12.034229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5e27d-5f5c-4df4-beb3-9cdf74958967 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:12.062957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:12.067091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0918ca-6c72-4555-b610-5c4a703f2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:12.069026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0918ca-6c72-4555-b610-5c4a703f2dbb None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:12.069776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0918ca-6c72-4555-b610-5c4a703f2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:12.070347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0918ca-6c72-4555-b610-5c4a703f2dbb None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:12.071270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0918ca-6c72-4555-b610-5c4a703f2dbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:12.073313 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0918ca-6c72-4555-b610-5c4a703f2dbb None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:12.073528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa41016-5f1a-4b4a-9957-ca7496f40890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:12.074390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41016-5f1a-4b4a-9957-ca7496f40890 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:12.074680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41016-5f1a-4b4a-9957-ca7496f40890 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:12.074961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa41016-5f1a-4b4a-9957-ca7496f40890 None admin] PATH_INFO: `/v3/users/5378967c222f4955b341ef9abaae44b4` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:12.089595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa41016-5f1a-4b4a-9957-ca7496f40890 None admin] RBAC: Authorizing `identity:get_user(user_id=5378967c222f4955b341ef9abaae44b4)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:12.091191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa41016-5f1a-4b4a-9957-ca7496f40890 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:12.093227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 122/243] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:11 2022] GET /identity/v3/users/5378967c222f4955b341ef9abaae44b4 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:12.094460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f53a7f-c256-455d-98c2-f7f539a1116b None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:12.094779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f53a7f-c256-455d-98c2-f7f539a1116b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:12.095035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f53a7f-c256-455d-98c2-f7f539a1116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:12.108499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 122/244] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:54:11 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:54:12.109629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0918ca-6c72-4555-b610-5c4a703f2dbb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:12.127787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-78f53a7f-c256-455d-98c2-f7f539a1116b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:12.129034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-78f53a7f-c256-455d-98c2-f7f539a1116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:12.235885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0918ca-6c72-4555-b610-5c4a703f2dbb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:12.282296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e032d-a511-436b-a7c7-5317145617b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:12.283820 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e032d-a511-436b-a7c7-5317145617b3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:12.284381 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e032d-a511-436b-a7c7-5317145617b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:12.284868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e032d-a511-436b-a7c7-5317145617b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:12.304854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:12.326404 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 123/245] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:12.354599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f53a7f-c256-455d-98c2-f7f539a1116b None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:12.393264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e032d-a511-436b-a7c7-5317145617b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:12.395896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e032d-a511-436b-a7c7-5317145617b3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:12.474493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f53a7f-c256-455d-98c2-f7f539a1116b None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:12.489213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:12.505102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:12.512396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06a80-9b16-46ca-9690-7f8975282b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:12.513071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 123/246] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:12.513178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06a80-9b16-46ca-9690-7f8975282b5d None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:12.513458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06a80-9b16-46ca-9690-7f8975282b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:12.513730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e06a80-9b16-46ca-9690-7f8975282b5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:12.519531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e032d-a511-436b-a7c7-5317145617b3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:12.526449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e06a80-9b16-46ca-9690-7f8975282b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-22e06a80-9b16-46ca-9690-7f8975282b5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:12.536380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:12.537283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:12.538114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 124/247] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:54:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:12.543698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06a80-9b16-46ca-9690-7f8975282b5d None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:12.647125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e032d-a511-436b-a7c7-5317145617b3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:12.667862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e06a80-9b16-46ca-9690-7f8975282b5d None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:12.691383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d416dfe-61c7-4cdf-a403-fd4dab05476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:12.692255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d416dfe-61c7-4cdf-a403-fd4dab05476d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:12.692566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d416dfe-61c7-4cdf-a403-fd4dab05476d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:12.692842 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d416dfe-61c7-4cdf-a403-fd4dab05476d None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:12.694462 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d416dfe-61c7-4cdf-a403-fd4dab05476d None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:12.696423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d416dfe-61c7-4cdf-a403-fd4dab05476d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:12.699154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 124/248] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:12 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:12.701710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a66f7-d087-42f6-862e-aff53f6598ca None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:12.702003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a66f7-d087-42f6-862e-aff53f6598ca None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:12.702285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a66f7-d087-42f6-862e-aff53f6598ca None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:12.704124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 125/249] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:12.704882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a66f7-d087-42f6-862e-aff53f6598ca None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:12.711784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070d95a-af11-4946-8e57-741b3bf02060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:12.712759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d95a-af11-4946-8e57-741b3bf02060 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:12.713240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d95a-af11-4946-8e57-741b3bf02060 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:12.713521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070d95a-af11-4946-8e57-741b3bf02060 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:12.714292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070d95a-af11-4946-8e57-741b3bf02060 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:12.714607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070d95a-af11-4946-8e57-741b3bf02060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:12.716605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070d95a-af11-4946-8e57-741b3bf02060 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:12.726430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 125/250] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:12.728593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cc4f4-cbad-46ab-9c84-0c5c805482f8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:12.729103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cc4f4-cbad-46ab-9c84-0c5c805482f8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:12.729386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cc4f4-cbad-46ab-9c84-0c5c805482f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:12.748434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-298cc4f4-cbad-46ab-9c84-0c5c805482f8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:12.749654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-298cc4f4-cbad-46ab-9c84-0c5c805482f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:12.780857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:12.796600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:12.838817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a66f7-d087-42f6-862e-aff53f6598ca None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:12.874046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 126/251] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:12.875328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cc4f4-cbad-46ab-9c84-0c5c805482f8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:12.875620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e162a-897d-4596-bd10-62d0a86bd036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:12.876281 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e162a-897d-4596-bd10-62d0a86bd036 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:12.876589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e162a-897d-4596-bd10-62d0a86bd036 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:12.876865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e162a-897d-4596-bd10-62d0a86bd036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:12.877708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e162a-897d-4596-bd10-62d0a86bd036 None admin] RBAC: Adding query filter params (role.id=89ec31929ee14f1a94fa3a1f8cbd9438, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b, user.id=5378967c222f4955b341ef9abaae44b4) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:12.878023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e162a-897d-4596-bd10-62d0a86bd036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:12.884337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e162a-897d-4596-bd10-62d0a86bd036 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:12.887013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 126/252] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:12 2022] GET /identity/v3/role_assignments?user.id=5378967c222f4955b341ef9abaae44b4&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=89ec31929ee14f1a94fa3a1f8cbd9438 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:12.903485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e162a-897d-4596-bd10-62d0a86bd036 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:13.028592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e162a-897d-4596-bd10-62d0a86bd036 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:13.053223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cc4f4-cbad-46ab-9c84-0c5c805482f8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:13.059682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:13.069371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87eea5-1327-4c02-bf2a-ac9eeca13b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:13.070279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87eea5-1327-4c02-bf2a-ac9eeca13b2b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:13.070568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87eea5-1327-4c02-bf2a-ac9eeca13b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:13.071412 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87eea5-1327-4c02-bf2a-ac9eeca13b2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:13.084804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87eea5-1327-4c02-bf2a-ac9eeca13b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-7c87eea5-1327-4c02-bf2a-ac9eeca13b2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:13.093600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:13.094563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:13.095355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 127/253] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:13.096835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78129f9b-59f0-4a31-9d39-cf577db14104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:13.097179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106b16-ef19-4191-9f99-dee1a0a0ed33 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:13.097466 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106b16-ef19-4191-9f99-dee1a0a0ed33 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:13.097746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106b16-ef19-4191-9f99-dee1a0a0ed33 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:13.098659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78129f9b-59f0-4a31-9d39-cf577db14104 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:13.099148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78129f9b-59f0-4a31-9d39-cf577db14104 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:13.099403 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 128/254] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:13.099871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78129f9b-59f0-4a31-9d39-cf577db14104 None admin] PATH_INFO: `/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:13.100674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d106b16-ef19-4191-9f99-dee1a0a0ed33 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:13.101783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78129f9b-59f0-4a31-9d39-cf577db14104 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf6092b3d6f436fad8fe6ce639d3f83)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:13.103606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78129f9b-59f0-4a31-9d39-cf577db14104 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:13.105895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 127/255] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:12 2022] GET /identity/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:13.107372 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc8f4-afe8-4d42-8570-2eeb6bfcfcee None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:13.107893 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc8f4-afe8-4d42-8570-2eeb6bfcfcee None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:13.108408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dc8f4-afe8-4d42-8570-2eeb6bfcfcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:13.136640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-5a8dc8f4-afe8-4d42-8570-2eeb6bfcfcee None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:13.138722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5a8dc8f4-afe8-4d42-8570-2eeb6bfcfcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:13.178402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:13.245165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 128/256] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:13.253256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dc8f4-afe8-4d42-8570-2eeb6bfcfcee None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:13.266007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d106b16-ef19-4191-9f99-dee1a0a0ed33 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:13.337377 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28845396-eee2-4b81-abf1-c50e9416d100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:13.337998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845396-eee2-4b81-abf1-c50e9416d100 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:13.338234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845396-eee2-4b81-abf1-c50e9416d100 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:13.338509 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28845396-eee2-4b81-abf1-c50e9416d100 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:13.339265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28845396-eee2-4b81-abf1-c50e9416d100 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:13.339575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28845396-eee2-4b81-abf1-c50e9416d100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:13.341000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28845396-eee2-4b81-abf1-c50e9416d100 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:13.360852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 129/257] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:13.361731 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28845396-eee2-4b81-abf1-c50e9416d100 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:13.433329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dc8f4-afe8-4d42-8570-2eeb6bfcfcee None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:13.454341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:13.500597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa81fb-5816-4e57-92a7-0a455f188d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:13.501258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa81fb-5816-4e57-92a7-0a455f188d11 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:13.501544 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa81fb-5816-4e57-92a7-0a455f188d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:13.501824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa81fb-5816-4e57-92a7-0a455f188d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:13.542696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28845396-eee2-4b81-abf1-c50e9416d100 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:13.554673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:13.591995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889361d0-4087-4b58-be8b-ec075820a80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:13.593872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889361d0-4087-4b58-be8b-ec075820a80c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:13.595622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889361d0-4087-4b58-be8b-ec075820a80c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:13.596050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889361d0-4087-4b58-be8b-ec075820a80c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:13.615918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889361d0-4087-4b58-be8b-ec075820a80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-889361d0-4087-4b58-be8b-ec075820a80c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:13.625003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:13.626045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:13.627028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:13.628907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 130/258] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:54:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:13.630324 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889361d0-4087-4b58-be8b-ec075820a80c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:13.645417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa81fb-5816-4e57-92a7-0a455f188d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:13.646915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa81fb-5816-4e57-92a7-0a455f188d11 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:13.743518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889361d0-4087-4b58-be8b-ec075820a80c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:13.760635 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:13.790897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22952b19-68f6-491d-b46a-7ce106cbe267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:13.792080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952b19-68f6-491d-b46a-7ce106cbe267 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:13.792709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952b19-68f6-491d-b46a-7ce106cbe267 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:13.794009 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22952b19-68f6-491d-b46a-7ce106cbe267 None admin] PATH_INFO: `/v3/users/84f42fedddac4c0db53e48f41497c5ef` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:13.800516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22952b19-68f6-491d-b46a-7ce106cbe267 None admin] RBAC: Authorizing `identity:get_user(user_id=84f42fedddac4c0db53e48f41497c5ef)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:13.802157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22952b19-68f6-491d-b46a-7ce106cbe267 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:13.804678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 131/259] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:13 2022] GET /identity/v3/users/84f42fedddac4c0db53e48f41497c5ef => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:13.806144 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22952b19-68f6-491d-b46a-7ce106cbe267 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:13.856991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 129/260] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:13.858061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa81fb-5816-4e57-92a7-0a455f188d11 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:13.989728 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:14.008777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22952b19-68f6-491d-b46a-7ce106cbe267 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:14.055827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa81fb-5816-4e57-92a7-0a455f188d11 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:14.074670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716c381-74a5-4c0a-b25d-b51c2aa7b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:14.075346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716c381-74a5-4c0a-b25d-b51c2aa7b9bc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:14.075633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716c381-74a5-4c0a-b25d-b51c2aa7b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:14.075913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716c381-74a5-4c0a-b25d-b51c2aa7b9bc None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:14.079399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716c381-74a5-4c0a-b25d-b51c2aa7b9bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:14.079723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716c381-74a5-4c0a-b25d-b51c2aa7b9bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:14.082163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716c381-74a5-4c0a-b25d-b51c2aa7b9bc None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:14.096634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 132/261] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:14.097449 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716c381-74a5-4c0a-b25d-b51c2aa7b9bc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:14.105328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87690d7-7e7a-4f85-834b-68a81291d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:14.106191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87690d7-7e7a-4f85-834b-68a81291d191 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:14.106478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87690d7-7e7a-4f85-834b-68a81291d191 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:14.106756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87690d7-7e7a-4f85-834b-68a81291d191 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:14.108823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87690d7-7e7a-4f85-834b-68a81291d191 None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:14.114882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87690d7-7e7a-4f85-834b-68a81291d191 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:14.116652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 130/262] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:13 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:14.117418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87690d7-7e7a-4f85-834b-68a81291d191 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:14.171054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:14.276263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716c381-74a5-4c0a-b25d-b51c2aa7b9bc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:14.299164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87690d7-7e7a-4f85-834b-68a81291d191 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:14.337893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a8c4d-be02-44c4-b6ee-1d67ea786154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:14.338771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a8c4d-be02-44c4-b6ee-1d67ea786154 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:14.339060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a8c4d-be02-44c4-b6ee-1d67ea786154 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:14.339342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a8c4d-be02-44c4-b6ee-1d67ea786154 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:14.340764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a8c4d-be02-44c4-b6ee-1d67ea786154 None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:14.342256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a8c4d-be02-44c4-b6ee-1d67ea786154 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:14.343993 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 133/263] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:14 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:14.344772 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a8c4d-be02-44c4-b6ee-1d67ea786154 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:14.355684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:14.366931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca15ab2-ab6f-4d39-9f13-9c87410c6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:14.367776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca15ab2-ab6f-4d39-9f13-9c87410c6691 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:14.368065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca15ab2-ab6f-4d39-9f13-9c87410c6691 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:14.368361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca15ab2-ab6f-4d39-9f13-9c87410c6691 None admin] PATH_INFO: `/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:14.371273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca15ab2-ab6f-4d39-9f13-9c87410c6691 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf6092b3d6f436fad8fe6ce639d3f83)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:14.372773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca15ab2-ab6f-4d39-9f13-9c87410c6691 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:14.374742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 131/264] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:14 2022] GET /identity/v3/users/dbf6092b3d6f436fad8fe6ce639d3f83 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:14.376031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca15ab2-ab6f-4d39-9f13-9c87410c6691 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:14.516136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a8c4d-be02-44c4-b6ee-1d67ea786154 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:14.530427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:14.554500 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d655f-d047-47ee-9ff6-b94084c66e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:14.555567 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca15ab2-ab6f-4d39-9f13-9c87410c6691 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:14.556011 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d655f-d047-47ee-9ff6-b94084c66e4a None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:14.556011 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d655f-d047-47ee-9ff6-b94084c66e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:14.556380 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d655f-d047-47ee-9ff6-b94084c66e4a None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/users/84f42fedddac4c0db53e48f41497c5ef/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:14.558749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d655f-d047-47ee-9ff6-b94084c66e4a None admin] RBAC: Authorizing `identity:create_grant(project_id=7761a3e3dfee4860bce7efebb2025a4b, user_id=84f42fedddac4c0db53e48f41497c5ef, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:14.560363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d655f-d047-47ee-9ff6-b94084c66e4a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:14.577433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 134/265] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:54:14 2022] PUT /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/users/84f42fedddac4c0db53e48f41497c5ef/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:54:14.578725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d655f-d047-47ee-9ff6-b94084c66e4a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:14.672338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a7417-b994-418d-8bc5-09dc23293b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:14.672999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a7417-b994-418d-8bc5-09dc23293b80 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:14.673281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a7417-b994-418d-8bc5-09dc23293b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:14.673558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a7417-b994-418d-8bc5-09dc23293b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:14.674415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a7417-b994-418d-8bc5-09dc23293b80 None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b, user.id=dbf6092b3d6f436fad8fe6ce639d3f83) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:14.674731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a7417-b994-418d-8bc5-09dc23293b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:14.676233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a7417-b994-418d-8bc5-09dc23293b80 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:14.694727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 132/266] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:14 2022] GET /identity/v3/role_assignments?user.id=dbf6092b3d6f436fad8fe6ce639d3f83&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:14.699738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d655f-d047-47ee-9ff6-b94084c66e4a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:14.739478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca553d-2bcf-4c5e-88ee-790405d558ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:14.740254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca553d-2bcf-4c5e-88ee-790405d558ef None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:14.740645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca553d-2bcf-4c5e-88ee-790405d558ef None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:14.740999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca553d-2bcf-4c5e-88ee-790405d558ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:14.787670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:14.821602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca553d-2bcf-4c5e-88ee-790405d558ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:14.823325 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca553d-2bcf-4c5e-88ee-790405d558ef None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:14.933670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 135/267] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:14.939445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a7417-b994-418d-8bc5-09dc23293b80 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:15.010748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:15.053949 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a7417-b994-418d-8bc5-09dc23293b80 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:15.083130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc8de9-aed7-461a-83d8-8d732925d34c None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.083426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc8de9-aed7-461a-83d8-8d732925d34c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.083707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc8de9-aed7-461a-83d8-8d732925d34c None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.086272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 136/268] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:15.093419 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f3e97-c16c-47bf-a27e-dd4a82c6efe1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.093859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f3e97-c16c-47bf-a27e-dd4a82c6efe1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.094416 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f3e97-c16c-47bf-a27e-dd4a82c6efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.104361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cd968-79d4-4ecf-9444-b034530c47a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:15.105225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cd968-79d4-4ecf-9444-b034530c47a3 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.105508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cd968-79d4-4ecf-9444-b034530c47a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.105789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cd968-79d4-4ecf-9444-b034530c47a3 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.109066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cd968-79d4-4ecf-9444-b034530c47a3 None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:15.110564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cd968-79d4-4ecf-9444-b034530c47a3 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:15.112643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 133/269] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:14 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:15.121309 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-874f3e97-c16c-47bf-a27e-dd4a82c6efe1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:15.121441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cd968-79d4-4ecf-9444-b034530c47a3 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:15.122662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-874f3e97-c16c-47bf-a27e-dd4a82c6efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:15.192881 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:15.198654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 137/270] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:15.223757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f3e97-c16c-47bf-a27e-dd4a82c6efe1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:15.339666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f3e97-c16c-47bf-a27e-dd4a82c6efe1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:15.377824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cd968-79d4-4ecf-9444-b034530c47a3 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:15.383869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1f91c-b1b7-4e78-b9eb-db7ee4de8cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:15.384916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1f91c-b1b7-4e78-b9eb-db7ee4de8cea None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.385350 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1f91c-b1b7-4e78-b9eb-db7ee4de8cea None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.385796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1f91c-b1b7-4e78-b9eb-db7ee4de8cea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.387828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1f91c-b1b7-4e78-b9eb-db7ee4de8cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:15.389513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1f91c-b1b7-4e78-b9eb-db7ee4de8cea None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:15.392138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 138/271] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:15.393551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d8e16-360a-4df6-a014-d90f87bb761e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.393987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d8e16-360a-4df6-a014-d90f87bb761e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.394412 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d8e16-360a-4df6-a014-d90f87bb761e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.400399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 139/272] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:15.401993 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d069ed-7594-41fd-af36-f7339e3ef722 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.402336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d069ed-7594-41fd-af36-f7339e3ef722 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.402689 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d069ed-7594-41fd-af36-f7339e3ef722 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.404090 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 140/273] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:15.405006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d069ed-7594-41fd-af36-f7339e3ef722 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:15.421981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:15.428646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e045524-dc00-4977-be4f-3b72b4df0948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:15.429527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045524-dc00-4977-be4f-3b72b4df0948 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.430622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045524-dc00-4977-be4f-3b72b4df0948 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.430909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e045524-dc00-4977-be4f-3b72b4df0948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.431771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e045524-dc00-4977-be4f-3b72b4df0948 None admin] RBAC: Adding query filter params (role.id=5cdb558ab7044154896c8f9e3dfba431, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b, user.id=dbf6092b3d6f436fad8fe6ce639d3f83) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:15.432091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e045524-dc00-4977-be4f-3b72b4df0948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:15.433977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e045524-dc00-4977-be4f-3b72b4df0948 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:15.440053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 134/274] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:15 2022] GET /identity/v3/role_assignments?user.id=dbf6092b3d6f436fad8fe6ce639d3f83&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=5cdb558ab7044154896c8f9e3dfba431 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:15.447066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b6f68-0132-44d4-9537-1e421e77369d None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.447836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b6f68-0132-44d4-9537-1e421e77369d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.448338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b6f68-0132-44d4-9537-1e421e77369d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.473046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-763b6f68-0132-44d4-9537-1e421e77369d None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:15.475265 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-763b6f68-0132-44d4-9537-1e421e77369d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:15.486533 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:15.527833 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d069ed-7594-41fd-af36-f7339e3ef722 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:15.563700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 135/275] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:15.565863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11d376-4f04-43c3-bed5-b590554fefb4 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.566157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11d376-4f04-43c3-bed5-b590554fefb4 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.566440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11d376-4f04-43c3-bed5-b590554fefb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.573490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87ee7-0dd1-43c7-bd2f-db122c10a3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:15.574178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87ee7-0dd1-43c7-bd2f-db122c10a3a1 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.574463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87ee7-0dd1-43c7-bd2f-db122c10a3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.574741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87ee7-0dd1-43c7-bd2f-db122c10a3a1 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.575468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f87ee7-0dd1-43c7-bd2f-db122c10a3a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:15.576985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f87ee7-0dd1-43c7-bd2f-db122c10a3a1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:15.594065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-5a11d376-4f04-43c3-bed5-b590554fefb4 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:15.596128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5a11d376-4f04-43c3-bed5-b590554fefb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:15.600733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 141/276] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:54:15 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:54:15.601797 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87ee7-0dd1-43c7-bd2f-db122c10a3a1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:15.688803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 136/277] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:15.708381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11d376-4f04-43c3-bed5-b590554fefb4 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:15.756753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87ee7-0dd1-43c7-bd2f-db122c10a3a1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:15.784140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:15.792835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:15.804346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1be7a2-1d9b-4ddf-89f1-91e1505d357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:15.804346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1be7a2-1d9b-4ddf-89f1-91e1505d357a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.804640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1be7a2-1d9b-4ddf-89f1-91e1505d357a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.804853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1be7a2-1d9b-4ddf-89f1-91e1505d357a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.819231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1be7a2-1d9b-4ddf-89f1-91e1505d357a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-8f1be7a2-1d9b-4ddf-89f1-91e1505d357a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:15.829807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:15.830736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:15.831519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 142/278] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:15.838090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11d376-4f04-43c3-bed5-b590554fefb4 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:15.838327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1be7a2-1d9b-4ddf-89f1-91e1505d357a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:15.877899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0e296-dc39-41b9-bc75-ab325ef1f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:15.879238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0e296-dc39-41b9-bc75-ab325ef1f185 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:15.880006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0e296-dc39-41b9-bc75-ab325ef1f185 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:15.880776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0e296-dc39-41b9-bc75-ab325ef1f185 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:15.894978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0e296-dc39-41b9-bc75-ab325ef1f185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-68c0e296-dc39-41b9-bc75-ab325ef1f185 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:15.905499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:15.906395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:15.907263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:15.909162 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 137/279] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:15.915450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0e296-dc39-41b9-bc75-ab325ef1f185 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:15.966682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1be7a2-1d9b-4ddf-89f1-91e1505d357a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:16.009593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2c15c-4fc3-4b1f-aa23-8678fd530fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:16.010260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c15c-4fc3-4b1f-aa23-8678fd530fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:16.010542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c15c-4fc3-4b1f-aa23-8678fd530fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:16.010816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c15c-4fc3-4b1f-aa23-8678fd530fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:16.011574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2c15c-4fc3-4b1f-aa23-8678fd530fe4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:16.011884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2c15c-4fc3-4b1f-aa23-8678fd530fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:16.013325 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2c15c-4fc3-4b1f-aa23-8678fd530fe4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:16.024218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 143/280] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:16.029917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2c15c-4fc3-4b1f-aa23-8678fd530fe4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:16.040604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0e296-dc39-41b9-bc75-ab325ef1f185 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:16.080714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:16.081577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a4877-afaa-4c83-8b93-a86d5928f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:16.082360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a4877-afaa-4c83-8b93-a86d5928f519 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:16.082759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a4877-afaa-4c83-8b93-a86d5928f519 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:16.083868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a4877-afaa-4c83-8b93-a86d5928f519 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:16.084884 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a4877-afaa-4c83-8b93-a86d5928f519 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:16.085212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a4877-afaa-4c83-8b93-a86d5928f519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:16.086778 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a4877-afaa-4c83-8b93-a86d5928f519 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:16.097399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 138/281] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:16.098053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:16.102938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a4877-afaa-4c83-8b93-a86d5928f519 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:16.179568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2c15c-4fc3-4b1f-aa23-8678fd530fe4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:16.225790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f5ba2-12b5-45c6-b99e-ce24f6565e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:16.225980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a4877-afaa-4c83-8b93-a86d5928f519 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:16.226600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f5ba2-12b5-45c6-b99e-ce24f6565e75 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:16.226941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f5ba2-12b5-45c6-b99e-ce24f6565e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:16.227219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f5ba2-12b5-45c6-b99e-ce24f6565e75 None admin] PATH_INFO: `/v3/users/7135db304f7143ccb9b8dcc525e1620e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:16.257113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f5ba2-12b5-45c6-b99e-ce24f6565e75 None admin] RBAC: Authorizing `identity:get_user(user_id=7135db304f7143ccb9b8dcc525e1620e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:16.258686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f5ba2-12b5-45c6-b99e-ce24f6565e75 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:16.260898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 144/282] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:16 2022] GET /identity/v3/users/7135db304f7143ccb9b8dcc525e1620e => generated 293 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:16.266132 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f5ba2-12b5-45c6-b99e-ce24f6565e75 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:16.279310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d472d-382d-45a0-a056-c23d9988ac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:16.280243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d472d-382d-45a0-a056-c23d9988ac13 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:16.280551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d472d-382d-45a0-a056-c23d9988ac13 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:16.280827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d472d-382d-45a0-a056-c23d9988ac13 None admin] PATH_INFO: `/v3/users/5378967c222f4955b341ef9abaae44b4` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:16.282590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d472d-382d-45a0-a056-c23d9988ac13 None admin] RBAC: Authorizing `identity:get_user(user_id=5378967c222f4955b341ef9abaae44b4)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:16.286559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d472d-382d-45a0-a056-c23d9988ac13 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:16.288243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 139/283] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:16 2022] GET /identity/v3/users/5378967c222f4955b341ef9abaae44b4 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:16.295260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d472d-382d-45a0-a056-c23d9988ac13 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:16.351117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:16.414031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d472d-382d-45a0-a056-c23d9988ac13 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:16.465034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092074b-0297-4440-9153-f1c97ce2a14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:16.465920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092074b-0297-4440-9153-f1c97ce2a14a None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:16.466205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092074b-0297-4440-9153-f1c97ce2a14a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:16.466482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092074b-0297-4440-9153-f1c97ce2a14a None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:16.467720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092074b-0297-4440-9153-f1c97ce2a14a None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:16.469208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092074b-0297-4440-9153-f1c97ce2a14a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:16.471234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 140/284] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:16 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:16.476736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092074b-0297-4440-9153-f1c97ce2a14a None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:16.490294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f5ba2-12b5-45c6-b99e-ce24f6565e75 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:16.492555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:16.556057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ec208-d3f1-40d6-b585-d5748a8a51e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:16.557218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec208-d3f1-40d6-b585-d5748a8a51e8 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:16.560338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec208-d3f1-40d6-b585-d5748a8a51e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:16.560882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ec208-d3f1-40d6-b585-d5748a8a51e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:16.561966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ec208-d3f1-40d6-b585-d5748a8a51e8 None admin] RBAC: Adding query filter params (role.id=9734fe47b63747daa9141041f1723e55, user.id=7135db304f7143ccb9b8dcc525e1620e, scope.system=all) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:16.562511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ec208-d3f1-40d6-b585-d5748a8a51e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:16.564176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ec208-d3f1-40d6-b585-d5748a8a51e8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:16.574536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 145/285] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Jun 20 05:54:16 2022] GET /identity/v3/role_assignments?user.id=7135db304f7143ccb9b8dcc525e1620e&scope.system=all&role.id=9734fe47b63747daa9141041f1723e55 => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:16.629271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092074b-0297-4440-9153-f1c97ce2a14a None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:16.649283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:16.682988 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b26ad-974a-469b-a7b3-fd99dba1643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:16.683906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b26ad-974a-469b-a7b3-fd99dba1643a None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:16.684190 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b26ad-974a-469b-a7b3-fd99dba1643a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:16.684491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b26ad-974a-469b-a7b3-fd99dba1643a None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/users/5378967c222f4955b341ef9abaae44b4/roles/89ec31929ee14f1a94fa3a1f8cbd9438` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:16.686631 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b26ad-974a-469b-a7b3-fd99dba1643a None admin] RBAC: Authorizing `identity:create_grant(project_id=7761a3e3dfee4860bce7efebb2025a4b, user_id=5378967c222f4955b341ef9abaae44b4, role_id=89ec31929ee14f1a94fa3a1f8cbd9438)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:16.688136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b26ad-974a-469b-a7b3-fd99dba1643a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:16.717526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 141/286] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:54:16 2022] PUT /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/users/5378967c222f4955b341ef9abaae44b4/roles/89ec31929ee14f1a94fa3a1f8cbd9438 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:54:17.327989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391b6e0-b24b-4dd5-9fc2-94078739d1d7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:17.328673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391b6e0-b24b-4dd5-9fc2-94078739d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:17.329215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391b6e0-b24b-4dd5-9fc2-94078739d1d7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:17.331127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 146/287] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:17.345737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b27bab-34d4-4b87-a5b3-704afa556700 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:17.346028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b27bab-34d4-4b87-a5b3-704afa556700 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:17.346309 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b27bab-34d4-4b87-a5b3-704afa556700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:17.369480 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c0b27bab-34d4-4b87-a5b3-704afa556700 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:17.370725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c0b27bab-34d4-4b87-a5b3-704afa556700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:17.458221 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 142/288] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:17.481716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391b6e0-b24b-4dd5-9fc2-94078739d1d7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:17.599195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391b6e0-b24b-4dd5-9fc2-94078739d1d7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:17.659805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bb449-7008-431b-a399-c8ecb6c43b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:17.661010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb449-7008-431b-a399-c8ecb6c43b1a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:17.661513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb449-7008-431b-a399-c8ecb6c43b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:17.661990 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bb449-7008-431b-a399-c8ecb6c43b1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:17.677434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bb449-7008-431b-a399-c8ecb6c43b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-eb7bb449-7008-431b-a399-c8ecb6c43b1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:17.686060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:17.686940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:17.687715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:17.690338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 147/289] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:17.696588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b27bab-34d4-4b87-a5b3-704afa556700 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:17.843429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b27bab-34d4-4b87-a5b3-704afa556700 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:17.848020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:17.892455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e0306-0d7e-4af5-a75e-2d24bac08118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:17.893118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e0306-0d7e-4af5-a75e-2d24bac08118 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:17.893400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e0306-0d7e-4af5-a75e-2d24bac08118 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:17.893670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e0306-0d7e-4af5-a75e-2d24bac08118 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:17.894418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e0306-0d7e-4af5-a75e-2d24bac08118 None admin] RBAC: Adding query filter params (name=member) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:17.894726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e0306-0d7e-4af5-a75e-2d24bac08118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:17.896100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e0306-0d7e-4af5-a75e-2d24bac08118 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:17.908115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 143/290] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:17.917389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bb449-7008-431b-a399-c8ecb6c43b1a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:17.971398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:18.076090 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bb449-7008-431b-a399-c8ecb6c43b1a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:18.121664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efff6fc-6fa2-4bc8-b458-a1bb71e239e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:18.122551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efff6fc-6fa2-4bc8-b458-a1bb71e239e9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:18.122836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efff6fc-6fa2-4bc8-b458-a1bb71e239e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:18.123114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efff6fc-6fa2-4bc8-b458-a1bb71e239e9 None admin] PATH_INFO: `/v3/users/84f42fedddac4c0db53e48f41497c5ef` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:18.124359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efff6fc-6fa2-4bc8-b458-a1bb71e239e9 None admin] RBAC: Authorizing `identity:get_user(user_id=84f42fedddac4c0db53e48f41497c5ef)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:18.125829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efff6fc-6fa2-4bc8-b458-a1bb71e239e9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:18.127777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 148/291] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:17 2022] GET /identity/v3/users/84f42fedddac4c0db53e48f41497c5ef => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:18.133700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e0306-0d7e-4af5-a75e-2d24bac08118 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:18.221730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0440b0-c455-4e47-b338-06869dcc85de None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:18.222037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0440b0-c455-4e47-b338-06869dcc85de None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:18.222215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0440b0-c455-4e47-b338-06869dcc85de None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:18.224003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 149/292] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:18.229529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af68f2-fca7-473d-8f6f-7b7986ac41cc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:18.229817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af68f2-fca7-473d-8f6f-7b7986ac41cc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:18.230103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af68f2-fca7-473d-8f6f-7b7986ac41cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:18.265436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-25af68f2-fca7-473d-8f6f-7b7986ac41cc None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:18.266675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-25af68f2-fca7-473d-8f6f-7b7986ac41cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:18.332790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e0306-0d7e-4af5-a75e-2d24bac08118 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:18.376239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 150/293] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:18.403164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251517e2-b05f-4aec-a72e-e14cae68687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:18.403826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251517e2-b05f-4aec-a72e-e14cae68687d None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:18.404117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251517e2-b05f-4aec-a72e-e14cae68687d None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:18.404433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251517e2-b05f-4aec-a72e-e14cae68687d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:18.416211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af68f2-fca7-473d-8f6f-7b7986ac41cc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:18.444872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:18.460625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:18.521286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251517e2-b05f-4aec-a72e-e14cae68687d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:18.524133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251517e2-b05f-4aec-a72e-e14cae68687d None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:18.597070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af68f2-fca7-473d-8f6f-7b7986ac41cc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:18.666900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca146d-2793-44a2-bcdb-feeb9b31afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:18.667700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca146d-2793-44a2-bcdb-feeb9b31afcf None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:18.667907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca146d-2793-44a2-bcdb-feeb9b31afcf None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:18.668180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca146d-2793-44a2-bcdb-feeb9b31afcf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:18.678605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca146d-2793-44a2-bcdb-feeb9b31afcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-ebca146d-2793-44a2-bcdb-feeb9b31afcf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:18.686445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:18.687322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:18.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:18.692339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 151/294] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:18.693634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d5103-a038-4d51-a13a-75ba296fb39e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:18.693917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d5103-a038-4d51-a13a-75ba296fb39e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:18.694267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d5103-a038-4d51-a13a-75ba296fb39e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:18.694670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 144/295] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:18.700356 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 152/296] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:18.700646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251517e2-b05f-4aec-a72e-e14cae68687d None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:18.701650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312096-996e-4366-a008-627cb65f7fbd None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:18.701880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312096-996e-4366-a008-627cb65f7fbd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:18.702159 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74312096-996e-4366-a008-627cb65f7fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:18.719302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-74312096-996e-4366-a008-627cb65f7fbd None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:18.720537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-74312096-996e-4366-a008-627cb65f7fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:18.773413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:18.790415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 153/297] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:18.797287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74312096-996e-4366-a008-627cb65f7fbd None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:18.816341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251517e2-b05f-4aec-a72e-e14cae68687d None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:18.842360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:18.856360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d508019-5b9a-4414-bcf3-44e243b46b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:18.857448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d508019-5b9a-4414-bcf3-44e243b46b6c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:18.857950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d508019-5b9a-4414-bcf3-44e243b46b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:18.858384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d508019-5b9a-4414-bcf3-44e243b46b6c None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:18.859227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d508019-5b9a-4414-bcf3-44e243b46b6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:18.859601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d508019-5b9a-4414-bcf3-44e243b46b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:18.861688 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d508019-5b9a-4414-bcf3-44e243b46b6c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:18.876351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 145/298] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:18.876351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d508019-5b9a-4414-bcf3-44e243b46b6c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:18.933054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74312096-996e-4366-a008-627cb65f7fbd None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:18.973797 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1243a5-010f-4cc2-a515-12a16fb2045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:18.975010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1243a5-010f-4cc2-a515-12a16fb2045d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:18.975294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1243a5-010f-4cc2-a515-12a16fb2045d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:18.975566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1243a5-010f-4cc2-a515-12a16fb2045d None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:18.977314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1243a5-010f-4cc2-a515-12a16fb2045d None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:18.979030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1243a5-010f-4cc2-a515-12a16fb2045d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:18.986438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 154/299] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:18 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:18.986438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1243a5-010f-4cc2-a515-12a16fb2045d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:18.989158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d508019-5b9a-4414-bcf3-44e243b46b6c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:19.019239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:19.029148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca402ea-cf5b-49a0-99de-558219127d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:19.029884 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca402ea-cf5b-49a0-99de-558219127d3a None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.030170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca402ea-cf5b-49a0-99de-558219127d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.030445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca402ea-cf5b-49a0-99de-558219127d3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.031718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca402ea-cf5b-49a0-99de-558219127d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:19.033215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca402ea-cf5b-49a0-99de-558219127d3a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:19.039332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 146/300] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:19.039332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0dc6-98f4-425d-b819-d09164640d6e None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.039332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0dc6-98f4-425d-b819-d09164640d6e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.039332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0dc6-98f4-425d-b819-d09164640d6e None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.039332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 147/301] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:19.039332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b0dc6-98f4-425d-b819-d09164640d6e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:19.080080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:19.105719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1243a5-010f-4cc2-a515-12a16fb2045d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:19.141461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8ccd8-a9bd-4494-a732-1f85403f7bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:19.142324 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8ccd8-a9bd-4494-a732-1f85403f7bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.142495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b0dc6-98f4-425d-b819-d09164640d6e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:19.142596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8ccd8-a9bd-4494-a732-1f85403f7bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.142866 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8ccd8-a9bd-4494-a732-1f85403f7bf3 None admin] PATH_INFO: `/v3/users/c857f19c1a414bfcbe201f82b0d1ad7a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.157704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8ccd8-a9bd-4494-a732-1f85403f7bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=c857f19c1a414bfcbe201f82b0d1ad7a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:19.159320 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8ccd8-a9bd-4494-a732-1f85403f7bf3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:19.166181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 155/302] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:18 2022] GET /identity/v3/users/c857f19c1a414bfcbe201f82b0d1ad7a => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:19.166181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8ccd8-a9bd-4494-a732-1f85403f7bf3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:19.181598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26add0b-f7af-4c5d-a699-e6ef530561b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:19.182260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26add0b-f7af-4c5d-a699-e6ef530561b8 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.182544 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26add0b-f7af-4c5d-a699-e6ef530561b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.182827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26add0b-f7af-4c5d-a699-e6ef530561b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.183665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26add0b-f7af-4c5d-a699-e6ef530561b8 None admin] RBAC: Adding query filter params (role.id=9734fe47b63747daa9141041f1723e55, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b, user.id=84f42fedddac4c0db53e48f41497c5ef) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:19.183985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26add0b-f7af-4c5d-a699-e6ef530561b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:19.185590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26add0b-f7af-4c5d-a699-e6ef530561b8 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:19.191653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 148/303] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:19 2022] GET /identity/v3/role_assignments?user.id=84f42fedddac4c0db53e48f41497c5ef&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=9734fe47b63747daa9141041f1723e55 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:19.192878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1868eb-bfd3-4b3a-b895-4385bc616c07 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.193175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1868eb-bfd3-4b3a-b895-4385bc616c07 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.193458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1868eb-bfd3-4b3a-b895-4385bc616c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.211988 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4b1868eb-bfd3-4b3a-b895-4385bc616c07 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:19.213261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4b1868eb-bfd3-4b3a-b895-4385bc616c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:19.281403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:19.294674 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 149/304] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:19.295549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1868eb-bfd3-4b3a-b895-4385bc616c07 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:19.300353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8ccd8-a9bd-4494-a732-1f85403f7bf3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:19.336767 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aba877-310c-4613-a770-9c4e8c8153f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:19.337440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aba877-310c-4613-a770-9c4e8c8153f6 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.337719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aba877-310c-4613-a770-9c4e8c8153f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.337991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aba877-310c-4613-a770-9c4e8c8153f6 None admin] PATH_INFO: `/v3/groups` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.338693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aba877-310c-4613-a770-9c4e8c8153f6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:19.340150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aba877-310c-4613-a770-9c4e8c8153f6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:19.352636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:19.364355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 156/305] 10.222.0.13 () {60 vars in 1134 bytes} [Mon Jun 20 05:54:19 2022] POST /identity/v3/groups => generated 229 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:54:19.364355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a53dcc-de99-47b3-b8eb-e269f87e3df6 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.364355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a53dcc-de99-47b3-b8eb-e269f87e3df6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.364355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a53dcc-de99-47b3-b8eb-e269f87e3df6 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.369747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 157/306] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:19.370690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a53dcc-de99-47b3-b8eb-e269f87e3df6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:19.424980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1868eb-bfd3-4b3a-b895-4385bc616c07 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:19.481544 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557aea5-36c6-4437-95a3-8a0abb470cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:19.482566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557aea5-36c6-4437-95a3-8a0abb470cff None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.482849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557aea5-36c6-4437-95a3-8a0abb470cff None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.483123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557aea5-36c6-4437-95a3-8a0abb470cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.483997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557aea5-36c6-4437-95a3-8a0abb470cff None admin] RBAC: Adding query filter params (role.id=89ec31929ee14f1a94fa3a1f8cbd9438, user.id=c857f19c1a414bfcbe201f82b0d1ad7a, scope.system=all) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:19.484409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557aea5-36c6-4437-95a3-8a0abb470cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:19.485834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557aea5-36c6-4437-95a3-8a0abb470cff None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:19.491679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 150/307] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Jun 20 05:54:19 2022] GET /identity/v3/role_assignments?user.id=c857f19c1a414bfcbe201f82b0d1ad7a&scope.system=all&role.id=89ec31929ee14f1a94fa3a1f8cbd9438 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:19.493864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f848b-59c7-4f54-907c-7d41e0436edb None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.494423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f848b-59c7-4f54-907c-7d41e0436edb None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.494920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f848b-59c7-4f54-907c-7d41e0436edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.514194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-851f848b-59c7-4f54-907c-7d41e0436edb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:19.515889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-851f848b-59c7-4f54-907c-7d41e0436edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:19.528064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a53dcc-de99-47b3-b8eb-e269f87e3df6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:19.575418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f122267-4da4-4e20-9f5f-56b86961c07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:19.576246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f122267-4da4-4e20-9f5f-56b86961c07c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.576556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f122267-4da4-4e20-9f5f-56b86961c07c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.577070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f122267-4da4-4e20-9f5f-56b86961c07c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.593978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f122267-4da4-4e20-9f5f-56b86961c07c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:19.598550 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6f122267-4da4-4e20-9f5f-56b86961c07c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:19.603783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:19.605053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:19.605861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 158/308] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:19.614518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f122267-4da4-4e20-9f5f-56b86961c07c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:19.625432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 151/309] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:19.651455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f848b-59c7-4f54-907c-7d41e0436edb None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:19.689521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:19.744544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f122267-4da4-4e20-9f5f-56b86961c07c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:19.785512 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f848b-59c7-4f54-907c-7d41e0436edb None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:19.793655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9414a1-3d08-47c1-b7a9-1afae5c59261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:19.794634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9414a1-3d08-47c1-b7a9-1afae5c59261 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.794977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9414a1-3d08-47c1-b7a9-1afae5c59261 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.795323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9414a1-3d08-47c1-b7a9-1afae5c59261 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.796143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9414a1-3d08-47c1-b7a9-1afae5c59261 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:19.796770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9414a1-3d08-47c1-b7a9-1afae5c59261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:19.798048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9414a1-3d08-47c1-b7a9-1afae5c59261 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:19.811999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 159/310] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:19.813256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9414a1-3d08-47c1-b7a9-1afae5c59261 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:19.837366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c957e-d4a1-4b18-9b46-8b49be572158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:19.839000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c957e-d4a1-4b18-9b46-8b49be572158 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.839742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c957e-d4a1-4b18-9b46-8b49be572158 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.840243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c957e-d4a1-4b18-9b46-8b49be572158 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.855360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c957e-d4a1-4b18-9b46-8b49be572158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-234c957e-d4a1-4b18-9b46-8b49be572158 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:19.866946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:19.868444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:19.869227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:19.872430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 152/311] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:19.878576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c957e-d4a1-4b18-9b46-8b49be572158 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:19.930812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9414a1-3d08-47c1-b7a9-1afae5c59261 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:19.943237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:19.957259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:19.971899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf05b8e-a420-404a-892f-d14832425ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:19.972915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05b8e-a420-404a-892f-d14832425ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:19.973199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05b8e-a420-404a-892f-d14832425ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:19.973471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf05b8e-a420-404a-892f-d14832425ff1 None admin] PATH_INFO: `/v3/users/7135db304f7143ccb9b8dcc525e1620e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:19.974685 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf05b8e-a420-404a-892f-d14832425ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=7135db304f7143ccb9b8dcc525e1620e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:19.976299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf05b8e-a420-404a-892f-d14832425ff1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:19.978158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 160/312] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:19 2022] GET /identity/v3/users/7135db304f7143ccb9b8dcc525e1620e => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:19.983848 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf05b8e-a420-404a-892f-d14832425ff1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:20.018670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c957e-d4a1-4b18-9b46-8b49be572158 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:20.066344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff81fe-97bd-463b-8203-2baaae376a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:20.067018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff81fe-97bd-463b-8203-2baaae376a95 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:20.067302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff81fe-97bd-463b-8203-2baaae376a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:20.067577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff81fe-97bd-463b-8203-2baaae376a95 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:20.068359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff81fe-97bd-463b-8203-2baaae376a95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:20.068664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff81fe-97bd-463b-8203-2baaae376a95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:20.070063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff81fe-97bd-463b-8203-2baaae376a95 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:20.078813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 153/313] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:20.085613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff81fe-97bd-463b-8203-2baaae376a95 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:20.095881 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf05b8e-a420-404a-892f-d14832425ff1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:20.139673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e73b1-a9de-4d36-a577-48dbfa09fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:20.140586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e73b1-a9de-4d36-a577-48dbfa09fa47 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:20.140868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e73b1-a9de-4d36-a577-48dbfa09fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:20.141141 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e73b1-a9de-4d36-a577-48dbfa09fa47 None admin] PATH_INFO: `/v3/system/users/7135db304f7143ccb9b8dcc525e1620e/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:20.143234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e73b1-a9de-4d36-a577-48dbfa09fa47 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7135db304f7143ccb9b8dcc525e1620e, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:20.144801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e73b1-a9de-4d36-a577-48dbfa09fa47 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:20.159385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 161/314] 10.222.0.13 () {58 vars in 1334 bytes} [Mon Jun 20 05:54:19 2022] PUT /identity/v3/system/users/7135db304f7143ccb9b8dcc525e1620e/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:54:20.216985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff81fe-97bd-463b-8203-2baaae376a95 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:20.225439 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:20.259322 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524c725-7355-47ae-a314-a13eed26b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:20.260332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524c725-7355-47ae-a314-a13eed26b378 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:20.260628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524c725-7355-47ae-a314-a13eed26b378 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:20.260941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524c725-7355-47ae-a314-a13eed26b378 None admin] PATH_INFO: `/v3/users/5378967c222f4955b341ef9abaae44b4` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:20.262202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524c725-7355-47ae-a314-a13eed26b378 None admin] RBAC: Authorizing `identity:get_user(user_id=5378967c222f4955b341ef9abaae44b4)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:20.263662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524c725-7355-47ae-a314-a13eed26b378 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:20.265736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 154/315] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:20 2022] GET /identity/v3/users/5378967c222f4955b341ef9abaae44b4 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:20.273619 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e73b1-a9de-4d36-a577-48dbfa09fa47 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:20.334348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:20.386009 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e73b1-a9de-4d36-a577-48dbfa09fa47 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:20.421892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17c9b1-2b33-48a8-a7ed-f3996d950794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:20.422537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17c9b1-2b33-48a8-a7ed-f3996d950794 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:20.422868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17c9b1-2b33-48a8-a7ed-f3996d950794 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:20.423148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17c9b1-2b33-48a8-a7ed-f3996d950794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:20.495005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17c9b1-2b33-48a8-a7ed-f3996d950794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:20.496795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17c9b1-2b33-48a8-a7ed-f3996d950794 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:20.554039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:20.603872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 162/316] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:20.609617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524c725-7355-47ae-a314-a13eed26b378 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:20.720271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524c725-7355-47ae-a314-a13eed26b378 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:20.755089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5bbe6-63e4-460c-abd7-965e5729f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:20.755955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5bbe6-63e4-460c-abd7-965e5729f266 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:20.756233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5bbe6-63e4-460c-abd7-965e5729f266 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:20.756534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5bbe6-63e4-460c-abd7-965e5729f266 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:20.757718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5bbe6-63e4-460c-abd7-965e5729f266 None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:20.759214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5bbe6-63e4-460c-abd7-965e5729f266 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:20.761234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 155/317] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:20 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:20.766615 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17c9b1-2b33-48a8-a7ed-f3996d950794 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:20.870114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17c9b1-2b33-48a8-a7ed-f3996d950794 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:20.904454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43901cf1-6861-4977-aca3-71e96403c51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:20.905105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43901cf1-6861-4977-aca3-71e96403c51a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:20.905393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43901cf1-6861-4977-aca3-71e96403c51a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:20.905666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43901cf1-6861-4977-aca3-71e96403c51a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:20.906551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43901cf1-6861-4977-aca3-71e96403c51a None admin] RBAC: Adding query filter params (role.id=89ec31929ee14f1a94fa3a1f8cbd9438, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b, user.id=5378967c222f4955b341ef9abaae44b4) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:20.906864 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43901cf1-6861-4977-aca3-71e96403c51a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:20.908359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43901cf1-6861-4977-aca3-71e96403c51a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:20.915177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 163/318] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:20 2022] GET /identity/v3/role_assignments?user.id=5378967c222f4955b341ef9abaae44b4&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=89ec31929ee14f1a94fa3a1f8cbd9438 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:21.539813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc2ba4-2be8-4646-a565-6f486c67185f None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:21.540361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc2ba4-2be8-4646-a565-6f486c67185f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:21.540361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc2ba4-2be8-4646-a565-6f486c67185f None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:21.541860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 156/319] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:21.546754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adfcb7-dadb-4ade-9b48-04fa5cea52cc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:21.547049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adfcb7-dadb-4ade-9b48-04fa5cea52cc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:21.547328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11adfcb7-dadb-4ade-9b48-04fa5cea52cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:21.564439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-11adfcb7-dadb-4ade-9b48-04fa5cea52cc None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:21.565633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-11adfcb7-dadb-4ade-9b48-04fa5cea52cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:21.578961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:21.630863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30f833-4fde-400d-a1ae-d1deb74511dd None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:21.631257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30f833-4fde-400d-a1ae-d1deb74511dd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:21.631425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30f833-4fde-400d-a1ae-d1deb74511dd None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:21.633484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 157/320] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:21.633589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 164/321] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:21.638362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2732-bd4f-45b8-96d3-45ea682eebd1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:21.638655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2732-bd4f-45b8-96d3-45ea682eebd1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:21.638935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2732-bd4f-45b8-96d3-45ea682eebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:21.655767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-031e2732-bd4f-45b8-96d3-45ea682eebd1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:21.656987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adfcb7-dadb-4ade-9b48-04fa5cea52cc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:21.657118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-031e2732-bd4f-45b8-96d3-45ea682eebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:21.693804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:21.732166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 158/322] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:21.753955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e2732-bd4f-45b8-96d3-45ea682eebd1 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:21.764412 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11adfcb7-dadb-4ade-9b48-04fa5cea52cc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:21.799796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9beae8-19d0-45cb-96fd-8200458992a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:21.800536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9beae8-19d0-45cb-96fd-8200458992a8 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:21.800821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9beae8-19d0-45cb-96fd-8200458992a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:21.801102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9beae8-19d0-45cb-96fd-8200458992a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:21.802275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9beae8-19d0-45cb-96fd-8200458992a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:21.803725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9beae8-19d0-45cb-96fd-8200458992a8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:21.805491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 165/323] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:21.810725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9beae8-19d0-45cb-96fd-8200458992a8 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:21.831843 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:21.861749 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e2732-bd4f-45b8-96d3-45ea682eebd1 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:21.897896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fa78c-9bc7-4f35-acb2-6cfc3d1b3d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:21.898753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa78c-9bc7-4f35-acb2-6cfc3d1b3d13 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:21.899042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa78c-9bc7-4f35-acb2-6cfc3d1b3d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:21.899334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa78c-9bc7-4f35-acb2-6cfc3d1b3d13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:21.910279 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fa78c-9bc7-4f35-acb2-6cfc3d1b3d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-014fa78c-9bc7-4f35-acb2-6cfc3d1b3d13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:21.918641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:21.919647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:21.920856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 159/324] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:21.923849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9beae8-19d0-45cb-96fd-8200458992a8 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:21.925631 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fa78c-9bc7-4f35-acb2-6cfc3d1b3d13 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:21.959886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:21.961126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3daf3-e2c3-4768-987f-d71e4214ee2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:21.961820 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3daf3-e2c3-4768-987f-d71e4214ee2d None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:21.962211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3daf3-e2c3-4768-987f-d71e4214ee2d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:21.962508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3daf3-e2c3-4768-987f-d71e4214ee2d None admin] PATH_INFO: `/v3/groups` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:21.963192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3daf3-e2c3-4768-987f-d71e4214ee2d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:21.964656 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3daf3-e2c3-4768-987f-d71e4214ee2d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:21.980356 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 166/325] 10.222.0.13 () {60 vars in 1134 bytes} [Mon Jun 20 05:54:21 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:54:22.047252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fa78c-9bc7-4f35-acb2-6cfc3d1b3d13 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:22.084207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c69a0-8679-492b-9924-8fd8032bc074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:22.084904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c69a0-8679-492b-9924-8fd8032bc074 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:22.085194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c69a0-8679-492b-9924-8fd8032bc074 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:22.085525 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c69a0-8679-492b-9924-8fd8032bc074 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:22.086400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c69a0-8679-492b-9924-8fd8032bc074 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:22.086717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c69a0-8679-492b-9924-8fd8032bc074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:22.088198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c69a0-8679-492b-9924-8fd8032bc074 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:22.097733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 160/326] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:22.105694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3daf3-e2c3-4768-987f-d71e4214ee2d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:22.189727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:22.215231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3daf3-e2c3-4768-987f-d71e4214ee2d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:22.227149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c586c48-1218-4885-bf49-d6c266db1099 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:22.227440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c586c48-1218-4885-bf49-d6c266db1099 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:22.227715 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c586c48-1218-4885-bf49-d6c266db1099 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:22.229295 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 161/327] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:54:22.234439 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0ccf-3f0c-4dc5-95e8-3372d8ac85a1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:22.235223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0ccf-3f0c-4dc5-95e8-3372d8ac85a1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:22.235223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d0ccf-3f0c-4dc5-95e8-3372d8ac85a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:22.259970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-874d0ccf-3f0c-4dc5-95e8-3372d8ac85a1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:22.260485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee0631-f69f-45b7-a32e-7a404fc1e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:22.261204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-874d0ccf-3f0c-4dc5-95e8-3372d8ac85a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:22.261399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee0631-f69f-45b7-a32e-7a404fc1e1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:22.261654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee0631-f69f-45b7-a32e-7a404fc1e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:22.261933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee0631-f69f-45b7-a32e-7a404fc1e1d9 None admin] PATH_INFO: `/v3/users/c857f19c1a414bfcbe201f82b0d1ad7a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:22.263167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee0631-f69f-45b7-a32e-7a404fc1e1d9 None admin] RBAC: Authorizing `identity:get_user(user_id=c857f19c1a414bfcbe201f82b0d1ad7a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:22.264650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee0631-f69f-45b7-a32e-7a404fc1e1d9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:22.266481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 167/328] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:22 2022] GET /identity/v3/users/c857f19c1a414bfcbe201f82b0d1ad7a => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:22.272079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee0631-f69f-45b7-a32e-7a404fc1e1d9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:22.337741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 162/329] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:22.363143 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0ccf-3f0c-4dc5-95e8-3372d8ac85a1 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:22.387607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee0631-f69f-45b7-a32e-7a404fc1e1d9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:22.401595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:22.431489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09052fce-5237-44a5-81da-a9816d073403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:22.433051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052fce-5237-44a5-81da-a9816d073403 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:22.433344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052fce-5237-44a5-81da-a9816d073403 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:22.433624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09052fce-5237-44a5-81da-a9816d073403 None admin] PATH_INFO: `/v3/system/users/c857f19c1a414bfcbe201f82b0d1ad7a/roles/89ec31929ee14f1a94fa3a1f8cbd9438` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:22.435774 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09052fce-5237-44a5-81da-a9816d073403 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c857f19c1a414bfcbe201f82b0d1ad7a, role_id=89ec31929ee14f1a94fa3a1f8cbd9438)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:22.437501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09052fce-5237-44a5-81da-a9816d073403 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:22.448424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 168/330] 10.222.0.13 () {58 vars in 1334 bytes} [Mon Jun 20 05:54:22 2022] PUT /identity/v3/system/users/c857f19c1a414bfcbe201f82b0d1ad7a/roles/89ec31929ee14f1a94fa3a1f8cbd9438 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:54:22.500065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d0ccf-3f0c-4dc5-95e8-3372d8ac85a1 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:22.549846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bcdfa-fe55-4846-80b7-88636821b23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:22.550673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bcdfa-fe55-4846-80b7-88636821b23f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:22.550962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bcdfa-fe55-4846-80b7-88636821b23f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:22.551242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bcdfa-fe55-4846-80b7-88636821b23f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:22.564682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bcdfa-fe55-4846-80b7-88636821b23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-fb3bcdfa-fe55-4846-80b7-88636821b23f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:22.573523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:22.574468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:22.575231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 163/331] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:22.582315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09052fce-5237-44a5-81da-a9816d073403 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:22.595514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:22.700884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09052fce-5237-44a5-81da-a9816d073403 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:22.737164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc06f6-9772-4ebd-9048-4807ed1f905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:22.737838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc06f6-9772-4ebd-9048-4807ed1f905e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:22.738129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc06f6-9772-4ebd-9048-4807ed1f905e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:22.738407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc06f6-9772-4ebd-9048-4807ed1f905e None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:22.739240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc06f6-9772-4ebd-9048-4807ed1f905e None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:22.739551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc06f6-9772-4ebd-9048-4807ed1f905e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:22.740984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc06f6-9772-4ebd-9048-4807ed1f905e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:22.750252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 169/332] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:22.755686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bcdfa-fe55-4846-80b7-88636821b23f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:22.849068 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:22.869647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bcdfa-fe55-4846-80b7-88636821b23f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:22.909128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fc8c3-bc28-47f4-a270-803b34e631bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:22.910004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc8c3-bc28-47f4-a270-803b34e631bf None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:22.910284 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc8c3-bc28-47f4-a270-803b34e631bf None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:22.910559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc8c3-bc28-47f4-a270-803b34e631bf None admin] PATH_INFO: `/v3/users/7135db304f7143ccb9b8dcc525e1620e` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:22.911770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fc8c3-bc28-47f4-a270-803b34e631bf None admin] RBAC: Authorizing `identity:get_user(user_id=7135db304f7143ccb9b8dcc525e1620e)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:22.913252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fc8c3-bc28-47f4-a270-803b34e631bf None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:22.915761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 164/333] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:22 2022] GET /identity/v3/users/7135db304f7143ccb9b8dcc525e1620e => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:22.921336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc06f6-9772-4ebd-9048-4807ed1f905e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:23.064613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:23.097684 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc06f6-9772-4ebd-9048-4807ed1f905e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:23.136684 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72375a0-02f8-480f-963d-e30bc6e30f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:23.137346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72375a0-02f8-480f-963d-e30bc6e30f68 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:23.137628 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72375a0-02f8-480f-963d-e30bc6e30f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:23.137899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72375a0-02f8-480f-963d-e30bc6e30f68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:23.138735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72375a0-02f8-480f-963d-e30bc6e30f68 None admin] RBAC: Adding query filter params (role.id=9734fe47b63747daa9141041f1723e55, user.id=7135db304f7143ccb9b8dcc525e1620e, scope.system=all) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:23.139050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72375a0-02f8-480f-963d-e30bc6e30f68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:23.140512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72375a0-02f8-480f-963d-e30bc6e30f68 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:23.157552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 170/334] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Jun 20 05:54:22 2022] GET /identity/v3/role_assignments?user.id=7135db304f7143ccb9b8dcc525e1620e&scope.system=all&role.id=9734fe47b63747daa9141041f1723e55 => generated 510 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:24.304068 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7fa2-3c92-4faf-ac81-ff79dd43512a None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:24.305598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7fa2-3c92-4faf-ac81-ff79dd43512a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:24.306073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b7fa2-3c92-4faf-ac81-ff79dd43512a None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:24.307898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 165/335] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:24.314451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e92d-8574-4a61-9bde-6b07fdb3dd15 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:24.315299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e92d-8574-4a61-9bde-6b07fdb3dd15 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:24.315769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e92d-8574-4a61-9bde-6b07fdb3dd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:24.338491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c740e92d-8574-4a61-9bde-6b07fdb3dd15 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:24.339986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c740e92d-8574-4a61-9bde-6b07fdb3dd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:24.418786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 171/336] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:24.442615 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b7fa2-3c92-4faf-ac81-ff79dd43512a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:24.548149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b7fa2-3c92-4faf-ac81-ff79dd43512a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:24.583986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4154f-0620-4f7b-a48e-9d3da4170a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:24.585078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4154f-0620-4f7b-a48e-9d3da4170a05 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:24.585505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4154f-0620-4f7b-a48e-9d3da4170a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:24.586465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4154f-0620-4f7b-a48e-9d3da4170a05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:24.597237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4154f-0620-4f7b-a48e-9d3da4170a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-42f4154f-0620-4f7b-a48e-9d3da4170a05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:24.605195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:24.606258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:24.607327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:24.609698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 166/337] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:24.615517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740e92d-8574-4a61-9bde-6b07fdb3dd15 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:24.677489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:24.716511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740e92d-8574-4a61-9bde-6b07fdb3dd15 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:24.751032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35426c98-45f0-4191-b598-fcff2e8ba6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:24.751701 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426c98-45f0-4191-b598-fcff2e8ba6ec None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:24.751983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426c98-45f0-4191-b598-fcff2e8ba6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:24.752258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35426c98-45f0-4191-b598-fcff2e8ba6ec None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:24.753041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35426c98-45f0-4191-b598-fcff2e8ba6ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:24.753347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35426c98-45f0-4191-b598-fcff2e8ba6ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:24.754738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35426c98-45f0-4191-b598-fcff2e8ba6ec None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:24.764128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 172/338] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:24.769554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4154f-0620-4f7b-a48e-9d3da4170a05 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:24.786198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:24.881542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4154f-0620-4f7b-a48e-9d3da4170a05 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:24.916712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82862b9-a54b-4629-a5fa-6f035fc63927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:24.917372 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82862b9-a54b-4629-a5fa-6f035fc63927 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:24.917658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82862b9-a54b-4629-a5fa-6f035fc63927 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:24.917932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82862b9-a54b-4629-a5fa-6f035fc63927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:24.987903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82862b9-a54b-4629-a5fa-6f035fc63927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:24.990664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82862b9-a54b-4629-a5fa-6f035fc63927 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:25.012679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:25.093472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 167/339] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:25.102161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35426c98-45f0-4191-b598-fcff2e8ba6ec None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:25.260079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35426c98-45f0-4191-b598-fcff2e8ba6ec None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:25.285623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:25.302239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80007-6f94-47da-bc9e-47c647a358bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:25.303106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80007-6f94-47da-bc9e-47c647a358bb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:25.303390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80007-6f94-47da-bc9e-47c647a358bb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:25.303664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80007-6f94-47da-bc9e-47c647a358bb None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:25.305492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80007-6f94-47da-bc9e-47c647a358bb None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:25.306959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80007-6f94-47da-bc9e-47c647a358bb None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:25.309491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 173/340] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:25 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:25.314073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82862b9-a54b-4629-a5fa-6f035fc63927 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:25.332795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30555323-374a-463c-beb7-dde10d48ee1b None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:25.333706 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30555323-374a-463c-beb7-dde10d48ee1b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:25.334165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30555323-374a-463c-beb7-dde10d48ee1b None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:25.336537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 174/341] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:25.341829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d6cf9-2409-4f08-a500-746443fa9125 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:25.342393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d6cf9-2409-4f08-a500-746443fa9125 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:25.342872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d6cf9-2409-4f08-a500-746443fa9125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:25.369892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-968d6cf9-2409-4f08-a500-746443fa9125 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:25.371418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-968d6cf9-2409-4f08-a500-746443fa9125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:25.468196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82862b9-a54b-4629-a5fa-6f035fc63927 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:25.496773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:25.515374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 175/342] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:25.531269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4e79f-5a6b-45ea-9997-c64ef0cdc7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:25.532130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4e79f-5a6b-45ea-9997-c64ef0cdc7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:25.532498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4e79f-5a6b-45ea-9997-c64ef0cdc7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:25.532781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4e79f-5a6b-45ea-9997-c64ef0cdc7a5 None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:25.542807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4e79f-5a6b-45ea-9997-c64ef0cdc7a5 None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:25.544272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4e79f-5a6b-45ea-9997-c64ef0cdc7a5 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:25.545983 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 168/343] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:25 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:25.551840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d6cf9-2409-4f08-a500-746443fa9125 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:25.566026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4e79f-5a6b-45ea-9997-c64ef0cdc7a5 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:25.720574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d6cf9-2409-4f08-a500-746443fa9125 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:25.741133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4e79f-5a6b-45ea-9997-c64ef0cdc7a5 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:25.741579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:25.763028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03beeb18-1fb4-4ab8-a081-9ada14011595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:25.763904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beeb18-1fb4-4ab8-a081-9ada14011595 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:25.764346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beeb18-1fb4-4ab8-a081-9ada14011595 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:25.764778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03beeb18-1fb4-4ab8-a081-9ada14011595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:25.765758 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beeb18-1fb4-4ab8-a081-9ada14011595 None admin] RBAC: Adding query filter params (group.id=a124381d3f514d8aa9d4294cf849a74c, role.id=9734fe47b63747daa9141041f1723e55, scope.project.id=352488bb649b45819bed25de31f1156f) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:25.766209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beeb18-1fb4-4ab8-a081-9ada14011595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:25.767787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03beeb18-1fb4-4ab8-a081-9ada14011595 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:25.775091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 176/344] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 20 05:54:25 2022] GET /identity/v3/role_assignments?group.id=a124381d3f514d8aa9d4294cf849a74c&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=9734fe47b63747daa9141041f1723e55 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:25.776882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85304d8-87ca-4858-b80f-28bec8ef8654 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:25.777325 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85304d8-87ca-4858-b80f-28bec8ef8654 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:25.777739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85304d8-87ca-4858-b80f-28bec8ef8654 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:25.779171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 177/345] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:25.780527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e4da-c6c5-4292-b15c-6aaba4d3e142 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:25.780977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e4da-c6c5-4292-b15c-6aaba4d3e142 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:25.781391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e4da-c6c5-4292-b15c-6aaba4d3e142 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:25.783120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 178/346] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:25.785245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea580d6b-f6f5-44be-ba66-614d830bfc73 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:25.785679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea580d6b-f6f5-44be-ba66-614d830bfc73 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:25.786084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea580d6b-f6f5-44be-ba66-614d830bfc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:25.792675 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b35535-9254-4845-a495-41f97ebc83ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:25.793580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35535-9254-4845-a495-41f97ebc83ea None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:25.793929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35535-9254-4845-a495-41f97ebc83ea None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:25.794218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b35535-9254-4845-a495-41f97ebc83ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:25.809265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ea580d6b-f6f5-44be-ba66-614d830bfc73 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:25.809453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b35535-9254-4845-a495-41f97ebc83ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:25.809528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ea580d6b-f6f5-44be-ba66-614d830bfc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-93b35535-9254-4845-a495-41f97ebc83ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:25.815681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:25.816682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:25.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 169/347] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:25.818722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3d29-1b83-430e-b6fd-e8da6e2fad76 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:25.819746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3d29-1b83-430e-b6fd-e8da6e2fad76 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:25.819746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3d29-1b83-430e-b6fd-e8da6e2fad76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:25.840438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c3ad3d29-1b83-430e-b6fd-e8da6e2fad76 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:25.841675 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c3ad3d29-1b83-430e-b6fd-e8da6e2fad76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:25.879149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:25.928482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 170/348] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:25.929519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad3d29-1b83-430e-b6fd-e8da6e2fad76 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:25.964541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 179/349] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:25.973501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea580d6b-f6f5-44be-ba66-614d830bfc73 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:26.069864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad3d29-1b83-430e-b6fd-e8da6e2fad76 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:26.105935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01bcf5-6156-4cc1-bad8-09a53b864002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:26.106847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01bcf5-6156-4cc1-bad8-09a53b864002 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:26.107272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01bcf5-6156-4cc1-bad8-09a53b864002 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:26.107678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01bcf5-6156-4cc1-bad8-09a53b864002 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:26.108632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01bcf5-6156-4cc1-bad8-09a53b864002 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:26.109080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01bcf5-6156-4cc1-bad8-09a53b864002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:26.110603 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01bcf5-6156-4cc1-bad8-09a53b864002 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:26.120150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 171/350] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:26.121271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01bcf5-6156-4cc1-bad8-09a53b864002 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:26.133248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea580d6b-f6f5-44be-ba66-614d830bfc73 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:26.148260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:26.151452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:26.184074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32a92a-7089-4cb3-9334-7c00604c258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:26.185204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a92a-7089-4cb3-9334-7c00604c258e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:26.185693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a92a-7089-4cb3-9334-7c00604c258e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:26.186163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32a92a-7089-4cb3-9334-7c00604c258e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:26.213291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32a92a-7089-4cb3-9334-7c00604c258e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-0d32a92a-7089-4cb3-9334-7c00604c258e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:26.221198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:26.222328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:26.223406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:26.231449 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 180/351] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:26.231718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01bcf5-6156-4cc1-bad8-09a53b864002 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:26.232624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32a92a-7089-4cb3-9334-7c00604c258e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:26.272184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0205b0-d388-4180-9a16-88db2e284bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:26.273985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0205b0-d388-4180-9a16-88db2e284bdd None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:26.274467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0205b0-d388-4180-9a16-88db2e284bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:26.274935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0205b0-d388-4180-9a16-88db2e284bdd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:26.286126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0205b0-d388-4180-9a16-88db2e284bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-3b0205b0-d388-4180-9a16-88db2e284bdd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:26.294519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:26.295369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:26.296150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:26.298529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 172/352] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:54:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:26.299516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0205b0-d388-4180-9a16-88db2e284bdd None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:26.394430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:26.406888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0205b0-d388-4180-9a16-88db2e284bdd None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:26.443379 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab43fbf-2280-4228-a49b-cb895a5b3f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:26.444436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43fbf-2280-4228-a49b-cb895a5b3f40 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:26.444919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43fbf-2280-4228-a49b-cb895a5b3f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:26.445450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43fbf-2280-4228-a49b-cb895a5b3f40 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:26.446420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab43fbf-2280-4228-a49b-cb895a5b3f40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:26.446923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab43fbf-2280-4228-a49b-cb895a5b3f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:26.448677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab43fbf-2280-4228-a49b-cb895a5b3f40 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:26.457907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 173/353] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:26.459146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab43fbf-2280-4228-a49b-cb895a5b3f40 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:26.551190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32a92a-7089-4cb3-9334-7c00604c258e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:26.569591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab43fbf-2280-4228-a49b-cb895a5b3f40 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:26.607148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b5932-9409-4672-9e51-d32eaf76998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:26.608159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b5932-9409-4672-9e51-d32eaf76998e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:26.608797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b5932-9409-4672-9e51-d32eaf76998e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:26.609290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b5932-9409-4672-9e51-d32eaf76998e None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:26.610237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b5932-9409-4672-9e51-d32eaf76998e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:26.610739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b5932-9409-4672-9e51-d32eaf76998e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:26.612341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b5932-9409-4672-9e51-d32eaf76998e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:26.616895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d329b-4aa3-4c58-9595-728bf17d6912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:26.617823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d329b-4aa3-4c58-9595-728bf17d6912 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:26.618108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d329b-4aa3-4c58-9595-728bf17d6912 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:26.618445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d329b-4aa3-4c58-9595-728bf17d6912 None admin] PATH_INFO: `/v3/users/c857f19c1a414bfcbe201f82b0d1ad7a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:26.620958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d329b-4aa3-4c58-9595-728bf17d6912 None admin] RBAC: Authorizing `identity:get_user(user_id=c857f19c1a414bfcbe201f82b0d1ad7a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:26.622370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 174/354] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:26.622493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d329b-4aa3-4c58-9595-728bf17d6912 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:26.623557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b5932-9409-4672-9e51-d32eaf76998e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:26.624134 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 181/355] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:54:26 2022] GET /identity/v3/users/c857f19c1a414bfcbe201f82b0d1ad7a => generated 293 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:26.632452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d329b-4aa3-4c58-9595-728bf17d6912 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:26.639406 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:26.702076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:26.729162 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b5932-9409-4672-9e51-d32eaf76998e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:26.764625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768b23b-1828-45a7-a697-b674d0b16612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:26.765629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b23b-1828-45a7-a697-b674d0b16612 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:26.766110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b23b-1828-45a7-a697-b674d0b16612 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:26.766596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768b23b-1828-45a7-a697-b674d0b16612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:26.810879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d329b-4aa3-4c58-9595-728bf17d6912 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:26.840067 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768b23b-1828-45a7-a697-b674d0b16612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:26.841882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768b23b-1828-45a7-a697-b674d0b16612 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:26.868199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:26.872566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771bb3c-b732-47ff-8b80-9061776516f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:26.873455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771bb3c-b732-47ff-8b80-9061776516f6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:26.874461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771bb3c-b732-47ff-8b80-9061776516f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:26.875116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771bb3c-b732-47ff-8b80-9061776516f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:26.954099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 175/356] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:26.957339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768b23b-1828-45a7-a697-b674d0b16612 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:26.962949 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771bb3c-b732-47ff-8b80-9061776516f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:26.964519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771bb3c-b732-47ff-8b80-9061776516f6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:27.014355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:27.085543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768b23b-1828-45a7-a697-b674d0b16612 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:27.101283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:27.101791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 182/357] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:27.103184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab0908-c5f8-4d1e-8eee-abcdefe353e0 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:27.103471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab0908-c5f8-4d1e-8eee-abcdefe353e0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:27.103747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab0908-c5f8-4d1e-8eee-abcdefe353e0 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:27.105349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 183/358] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:27.106678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9474e-5124-4375-9f70-a14917628cdb None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:27.107145 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9474e-5124-4375-9f70-a14917628cdb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:27.107637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9474e-5124-4375-9f70-a14917628cdb None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:27.109341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 184/359] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:27.110248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9474e-5124-4375-9f70-a14917628cdb None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:27.130805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00f2da-d3ab-46de-96ad-219e0467f0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:27.131788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00f2da-d3ab-46de-96ad-219e0467f0ec None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:27.132282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00f2da-d3ab-46de-96ad-219e0467f0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:27.132599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00f2da-d3ab-46de-96ad-219e0467f0ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:27.133989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00f2da-d3ab-46de-96ad-219e0467f0ec None admin] RBAC: Adding query filter params (role.id=89ec31929ee14f1a94fa3a1f8cbd9438, user.id=c857f19c1a414bfcbe201f82b0d1ad7a, scope.system=all) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:27.134303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00f2da-d3ab-46de-96ad-219e0467f0ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:27.136507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e00f2da-d3ab-46de-96ad-219e0467f0ec None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:27.152896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 176/360] 10.222.0.13 () {56 vars in 1308 bytes} [Mon Jun 20 05:54:26 2022] GET /identity/v3/role_assignments?user.id=c857f19c1a414bfcbe201f82b0d1ad7a&scope.system=all&role.id=89ec31929ee14f1a94fa3a1f8cbd9438 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:27.153975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00f2da-d3ab-46de-96ad-219e0467f0ec None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:27.277302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9474e-5124-4375-9f70-a14917628cdb None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:27.317482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e00f2da-d3ab-46de-96ad-219e0467f0ec None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:27.334932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadee1e1-9c69-433a-9e75-53e60287a5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:27.336438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee1e1-9c69-433a-9e75-53e60287a5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:27.336741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee1e1-9c69-433a-9e75-53e60287a5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:27.337017 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee1e1-9c69-433a-9e75-53e60287a5d7 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:27.338308 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadee1e1-9c69-433a-9e75-53e60287a5d7 None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:27.340166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadee1e1-9c69-433a-9e75-53e60287a5d7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:27.345552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 185/361] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:27 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:27.346736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e4340-30ab-44df-9ae0-e13226e7cba4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:27.347182 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e4340-30ab-44df-9ae0-e13226e7cba4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:27.347661 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e4340-30ab-44df-9ae0-e13226e7cba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:27.364299 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb72f3f-9c19-49a2-bc26-0375078c58f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:27.365244 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72f3f-9c19-49a2-bc26-0375078c58f3 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:27.365529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72f3f-9c19-49a2-bc26-0375078c58f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:27.365804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72f3f-9c19-49a2-bc26-0375078c58f3 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:27.367006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb72f3f-9c19-49a2-bc26-0375078c58f3 None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:27.369246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-aa9e4340-30ab-44df-9ae0-e13226e7cba4 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:27.370017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb72f3f-9c19-49a2-bc26-0375078c58f3 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:27.370571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-aa9e4340-30ab-44df-9ae0-e13226e7cba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:27.372270 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 177/362] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:27 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:27.373072 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:27.374728 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f64b19-afcb-45d4-b426-36ffbebfeffd None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:27.375227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f64b19-afcb-45d4-b426-36ffbebfeffd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:27.375708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f64b19-afcb-45d4-b426-36ffbebfeffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:27.397383 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-97f64b19-afcb-45d4-b426-36ffbebfeffd None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:27.399307 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-97f64b19-afcb-45d4-b426-36ffbebfeffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:27.440241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:27.453634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 186/363] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:27.454334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e4340-30ab-44df-9ae0-e13226e7cba4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:27.491199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 178/364] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:27.491842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f64b19-afcb-45d4-b426-36ffbebfeffd None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:27.592344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e4340-30ab-44df-9ae0-e13226e7cba4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:27.626285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f64b19-afcb-45d4-b426-36ffbebfeffd None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:27.640789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa4c57-9ed6-4b22-a3e4-19d72c9de001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:27.641819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa4c57-9ed6-4b22-a3e4-19d72c9de001 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:27.642211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa4c57-9ed6-4b22-a3e4-19d72c9de001 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:27.642952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa4c57-9ed6-4b22-a3e4-19d72c9de001 None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:27.644607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa4c57-9ed6-4b22-a3e4-19d72c9de001 None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:27.646502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa4c57-9ed6-4b22-a3e4-19d72c9de001 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:27.648791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 187/365] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:27 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:27.649398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa4c57-9ed6-4b22-a3e4-19d72c9de001 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:27.668684 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:27.673720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b685bfb-f2ed-4d46-99bb-97d9213d814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:27.674682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b685bfb-f2ed-4d46-99bb-97d9213d814a None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:27.675032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b685bfb-f2ed-4d46-99bb-97d9213d814a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:27.675320 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b685bfb-f2ed-4d46-99bb-97d9213d814a None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:27.677640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b685bfb-f2ed-4d46-99bb-97d9213d814a None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:27.679111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b685bfb-f2ed-4d46-99bb-97d9213d814a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:27.681690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 179/366] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:27 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:27.682629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b685bfb-f2ed-4d46-99bb-97d9213d814a None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:27.722831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:27.771344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa4c57-9ed6-4b22-a3e4-19d72c9de001 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:27.801568 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b685bfb-f2ed-4d46-99bb-97d9213d814a None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:27.822113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa39325-6d03-4e41-96ee-40fb2c507bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:27.822929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa39325-6d03-4e41-96ee-40fb2c507bbf None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:27.823216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa39325-6d03-4e41-96ee-40fb2c507bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:27.823491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa39325-6d03-4e41-96ee-40fb2c507bbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:27.837278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa39325-6d03-4e41-96ee-40fb2c507bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-7fa39325-6d03-4e41-96ee-40fb2c507bbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:27.845745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:27.846648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:27.847443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:27.848045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a87945-cea4-4b7b-95da-6ceb39c0694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:27.848140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 188/367] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:54:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:27.848209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87945-cea4-4b7b-95da-6ceb39c0694e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:27.848275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa39325-6d03-4e41-96ee-40fb2c507bbf None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:27.848365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87945-cea4-4b7b-95da-6ceb39c0694e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:27.854771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87945-cea4-4b7b-95da-6ceb39c0694e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:27.871647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a87945-cea4-4b7b-95da-6ceb39c0694e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-c5a87945-cea4-4b7b-95da-6ceb39c0694e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:27.881440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:27.882339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:27.883183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:27.885651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 180/368] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:54:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:27.886994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a87945-cea4-4b7b-95da-6ceb39c0694e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:27.938769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:27.981180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa39325-6d03-4e41-96ee-40fb2c507bbf None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:28.020587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:28.026195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1da52-8753-421c-9f1f-ee44f7299b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:28.026804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1da52-8753-421c-9f1f-ee44f7299b9c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:28.027088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1da52-8753-421c-9f1f-ee44f7299b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:28.027364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1da52-8753-421c-9f1f-ee44f7299b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:28.028209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1da52-8753-421c-9f1f-ee44f7299b9c None admin] RBAC: Adding query filter params (group.id=a124381d3f514d8aa9d4294cf849a74c, role.id=9734fe47b63747daa9141041f1723e55, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:28.028558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1da52-8753-421c-9f1f-ee44f7299b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:28.028651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a87945-cea4-4b7b-95da-6ceb39c0694e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:28.030024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1da52-8753-421c-9f1f-ee44f7299b9c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:28.038401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 189/369] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 20 05:54:27 2022] GET /identity/v3/role_assignments?group.id=a124381d3f514d8aa9d4294cf849a74c&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=9734fe47b63747daa9141041f1723e55 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:28.044341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1da52-8753-421c-9f1f-ee44f7299b9c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:28.072958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1ff65-d5e3-4d80-8852-6c933806a7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:28.073647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1ff65-d5e3-4d80-8852-6c933806a7fc None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:28.073980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1ff65-d5e3-4d80-8852-6c933806a7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:28.074266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1ff65-d5e3-4d80-8852-6c933806a7fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:28.075738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1ff65-d5e3-4d80-8852-6c933806a7fc None admin] RBAC: Adding query filter params (group.id=a124381d3f514d8aa9d4294cf849a74c, role.id=5cdb558ab7044154896c8f9e3dfba431, scope.project.id=352488bb649b45819bed25de31f1156f) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:28.076065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1ff65-d5e3-4d80-8852-6c933806a7fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:28.080523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1ff65-d5e3-4d80-8852-6c933806a7fc None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:28.088706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 181/370] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 20 05:54:27 2022] GET /identity/v3/role_assignments?group.id=a124381d3f514d8aa9d4294cf849a74c&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=5cdb558ab7044154896c8f9e3dfba431 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:28.089701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1ff65-d5e3-4d80-8852-6c933806a7fc None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:28.187019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1da52-8753-421c-9f1f-ee44f7299b9c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:28.216885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1ff65-d5e3-4d80-8852-6c933806a7fc None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:28.227568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adae74-e3e8-4b05-a9e3-be60ca62c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:28.228691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adae74-e3e8-4b05-a9e3-be60ca62c1ff None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:28.229178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adae74-e3e8-4b05-a9e3-be60ca62c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:28.229894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adae74-e3e8-4b05-a9e3-be60ca62c1ff None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:28.230888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adae74-e3e8-4b05-a9e3-be60ca62c1ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:28.231410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adae74-e3e8-4b05-a9e3-be60ca62c1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:28.233223 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adae74-e3e8-4b05-a9e3-be60ca62c1ff None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:28.235511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:28.255829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 190/371] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:28.261245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adae74-e3e8-4b05-a9e3-be60ca62c1ff None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:28.265468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f8e00-1f89-4671-9e5c-bf88b582c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:28.266522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f8e00-1f89-4671-9e5c-bf88b582c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:28.266959 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f8e00-1f89-4671-9e5c-bf88b582c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:28.267403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f8e00-1f89-4671-9e5c-bf88b582c0d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:28.268362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f8e00-1f89-4671-9e5c-bf88b582c0d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:28.268828 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f8e00-1f89-4671-9e5c-bf88b582c0d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:28.270471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f8e00-1f89-4671-9e5c-bf88b582c0d5 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:28.281330 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 182/372] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:28.287960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f8e00-1f89-4671-9e5c-bf88b582c0d5 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:28.360763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:28.389978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adae74-e3e8-4b05-a9e3-be60ca62c1ff None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:28.403749 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f8e00-1f89-4671-9e5c-bf88b582c0d5 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:28.444751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed90a0-3078-49e4-a146-d2dca9b295c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:28.445953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed90a0-3078-49e4-a146-d2dca9b295c1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:28.446239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed90a0-3078-49e4-a146-d2dca9b295c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:28.446555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed90a0-3078-49e4-a146-d2dca9b295c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:28.452918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fd46f-38c4-48ab-aaa3-04dfa4738d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:28.453793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fd46f-38c4-48ab-aaa3-04dfa4738d2f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:28.454228 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fd46f-38c4-48ab-aaa3-04dfa4738d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:28.454652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fd46f-38c4-48ab-aaa3-04dfa4738d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:28.528202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:28.540135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fd46f-38c4-48ab-aaa3-04dfa4738d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:28.540495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed90a0-3078-49e4-a146-d2dca9b295c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:28.541902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fd46f-38c4-48ab-aaa3-04dfa4738d2f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:28.542262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed90a0-3078-49e4-a146-d2dca9b295c1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:28.566704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:28.660221 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 191/373] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:28.661612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd0b99-1503-4282-af0d-568d3ce406b6 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:28.661905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd0b99-1503-4282-af0d-568d3ce406b6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:28.662187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd0b99-1503-4282-af0d-568d3ce406b6 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:28.663713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 192/374] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:28.665316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd0b99-1503-4282-af0d-568d3ce406b6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:28.670760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 183/375] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:28.672427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab69e8d-66e2-4658-ac78-58bbb3ee71da None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:28.673086 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab69e8d-66e2-4658-ac78-58bbb3ee71da None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:28.673564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab69e8d-66e2-4658-ac78-58bbb3ee71da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:28.693969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4ab69e8d-66e2-4658-ac78-58bbb3ee71da None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:28.696334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4ab69e8d-66e2-4658-ac78-58bbb3ee71da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:28.789722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 184/376] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:28.791224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab69e8d-66e2-4658-ac78-58bbb3ee71da None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:28.793141 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:28.807399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd0b99-1503-4282-af0d-568d3ce406b6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:28.854647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7d651-feb6-4188-acd9-88be1673d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:28.855914 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7d651-feb6-4188-acd9-88be1673d6cc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:28.856418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7d651-feb6-4188-acd9-88be1673d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:28.856891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7d651-feb6-4188-acd9-88be1673d6cc None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:28.858342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7d651-feb6-4188-acd9-88be1673d6cc None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:28.860033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7d651-feb6-4188-acd9-88be1673d6cc None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:28.862320 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:28.863390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 193/377] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:28 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:28.864423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7d651-feb6-4188-acd9-88be1673d6cc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:28.939537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab69e8d-66e2-4658-ac78-58bbb3ee71da None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:29.007345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1dcfe-8f02-4007-a8ff-014a48674d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:29.008405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1dcfe-8f02-4007-a8ff-014a48674d2b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:29.008771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1dcfe-8f02-4007-a8ff-014a48674d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:29.010442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1dcfe-8f02-4007-a8ff-014a48674d2b None admin] PATH_INFO: `/v3/projects/0a570b43b29a48ed93337d06e7d2c924` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:29.015712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1dcfe-8f02-4007-a8ff-014a48674d2b None admin] RBAC: Authorizing `identity:get_project(project_id=0a570b43b29a48ed93337d06e7d2c924)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:29.017600 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1dcfe-8f02-4007-a8ff-014a48674d2b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:29.020761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 185/378] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:28 2022] GET /identity/v3/projects/0a570b43b29a48ed93337d06e7d2c924 => generated 344 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:29.022785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1dcfe-8f02-4007-a8ff-014a48674d2b None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:29.047172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7d651-feb6-4188-acd9-88be1673d6cc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:29.089849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4c59f-82ea-462f-8c49-e754d24979fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:29.091154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4c59f-82ea-462f-8c49-e754d24979fb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:29.091803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4c59f-82ea-462f-8c49-e754d24979fb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:29.092288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4c59f-82ea-462f-8c49-e754d24979fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:29.103562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4c59f-82ea-462f-8c49-e754d24979fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-5bc4c59f-82ea-462f-8c49-e754d24979fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:29.115383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:29.116371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:29.117756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:29.120531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 194/379] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:29.124386 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4c59f-82ea-462f-8c49-e754d24979fb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:29.165720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1dcfe-8f02-4007-a8ff-014a48674d2b None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:29.173055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:29.193054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:29.215091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd68a8-137c-4f4f-8338-1778a6ae1a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:29.216359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd68a8-137c-4f4f-8338-1778a6ae1a39 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:29.216872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd68a8-137c-4f4f-8338-1778a6ae1a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:29.217684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd68a8-137c-4f4f-8338-1778a6ae1a39 None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:29.219940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd68a8-137c-4f4f-8338-1778a6ae1a39 None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:29.222293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd68a8-137c-4f4f-8338-1778a6ae1a39 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:29.233354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 186/380] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:29 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:29.234689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd68a8-137c-4f4f-8338-1778a6ae1a39 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:29.294879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4c59f-82ea-462f-8c49-e754d24979fb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:29.340106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9cb74-e447-478a-809f-33e35cb6189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:29.341334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9cb74-e447-478a-809f-33e35cb6189c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:29.341838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9cb74-e447-478a-809f-33e35cb6189c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:29.342331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9cb74-e447-478a-809f-33e35cb6189c None admin] PATH_INFO: `/v3/groups/ca15336ce76d4f659bfb1ef5269991b8` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:29.350974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9cb74-e447-478a-809f-33e35cb6189c None admin] RBAC: Authorizing `identity:get_group(group_id=ca15336ce76d4f659bfb1ef5269991b8)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:29.356789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9cb74-e447-478a-809f-33e35cb6189c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:29.359927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 195/381] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:29 2022] GET /identity/v3/groups/ca15336ce76d4f659bfb1ef5269991b8 => generated 229 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:29.371734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9cb74-e447-478a-809f-33e35cb6189c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:29.395049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd68a8-137c-4f4f-8338-1778a6ae1a39 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:29.440061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293e270-a137-4242-8228-5bd3e2178194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:29.441566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293e270-a137-4242-8228-5bd3e2178194 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:29.442072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293e270-a137-4242-8228-5bd3e2178194 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:29.442560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293e270-a137-4242-8228-5bd3e2178194 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:29.445927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293e270-a137-4242-8228-5bd3e2178194 None admin] RBAC: Adding query filter params (name=member) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:29.446500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293e270-a137-4242-8228-5bd3e2178194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:29.448148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293e270-a137-4242-8228-5bd3e2178194 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:29.458748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 187/382] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:29.459903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293e270-a137-4242-8228-5bd3e2178194 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:29.518982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:29.568690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:29.575820 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293e270-a137-4242-8228-5bd3e2178194 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:29.586497 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9cb74-e447-478a-809f-33e35cb6189c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:29.623760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae62c-b8f0-462d-9cbc-a26c22c8b521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:29.624488 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae62c-b8f0-462d-9cbc-a26c22c8b521 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:29.624773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae62c-b8f0-462d-9cbc-a26c22c8b521 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:29.625236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaae62c-b8f0-462d-9cbc-a26c22c8b521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:29.626230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae62c-b8f0-462d-9cbc-a26c22c8b521 None admin] RBAC: Adding query filter params (group.id=ca15336ce76d4f659bfb1ef5269991b8, role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=0a570b43b29a48ed93337d06e7d2c924) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:29.626707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae62c-b8f0-462d-9cbc-a26c22c8b521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:29.628370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaae62c-b8f0-462d-9cbc-a26c22c8b521 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:29.634222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 188/383] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 20 05:54:29 2022] GET /identity/v3/role_assignments?group.id=ca15336ce76d4f659bfb1ef5269991b8&scope.project.id=0a570b43b29a48ed93337d06e7d2c924&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:29.635155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae62c-b8f0-462d-9cbc-a26c22c8b521 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:29.636539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530300b-a585-4844-9109-3c152114f3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:29.637481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530300b-a585-4844-9109-3c152114f3eb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:29.637971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530300b-a585-4844-9109-3c152114f3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:29.638465 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530300b-a585-4844-9109-3c152114f3eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:29.639523 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530300b-a585-4844-9109-3c152114f3eb None admin] RBAC: Adding query filter params (group.id=a124381d3f514d8aa9d4294cf849a74c, role.id=5cdb558ab7044154896c8f9e3dfba431, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:29.640699 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530300b-a585-4844-9109-3c152114f3eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:29.642415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530300b-a585-4844-9109-3c152114f3eb None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:29.651232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 196/384] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 20 05:54:29 2022] GET /identity/v3/role_assignments?group.id=a124381d3f514d8aa9d4294cf849a74c&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=5cdb558ab7044154896c8f9e3dfba431 => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:29.800765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaae62c-b8f0-462d-9cbc-a26c22c8b521 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:29.818044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:29.841656 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d0d2d-3f01-41f5-92c2-c6be835983e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:29.842651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d0d2d-3f01-41f5-92c2-c6be835983e3 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:29.842946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d0d2d-3f01-41f5-92c2-c6be835983e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:29.843229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d0d2d-3f01-41f5-92c2-c6be835983e3 None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:29.844559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d0d2d-3f01-41f5-92c2-c6be835983e3 None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:29.846049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d0d2d-3f01-41f5-92c2-c6be835983e3 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:29.848142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 189/385] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:29 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:29.854271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530300b-a585-4844-9109-3c152114f3eb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:29.976752 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530300b-a585-4844-9109-3c152114f3eb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:30.014541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fccf6-e653-41d2-86cc-6eed8b2bef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:30.015746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fccf6-e653-41d2-86cc-6eed8b2bef7b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:30.016034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fccf6-e653-41d2-86cc-6eed8b2bef7b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:30.016335 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fccf6-e653-41d2-86cc-6eed8b2bef7b None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:30.017622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fccf6-e653-41d2-86cc-6eed8b2bef7b None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:30.019084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fccf6-e653-41d2-86cc-6eed8b2bef7b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:30.020844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 197/386] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:29 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:30.027423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d0d2d-3f01-41f5-92c2-c6be835983e3 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:30.138617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d0d2d-3f01-41f5-92c2-c6be835983e3 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:30.189308 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabd8b9-7854-4e5a-b221-46af93ab3df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:30.190216 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd8b9-7854-4e5a-b221-46af93ab3df2 None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:30.190505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd8b9-7854-4e5a-b221-46af93ab3df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:30.190786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabd8b9-7854-4e5a-b221-46af93ab3df2 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f/groups/a124381d3f514d8aa9d4294cf849a74c/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:30.192833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabd8b9-7854-4e5a-b221-46af93ab3df2 None admin] RBAC: Authorizing `identity:create_grant(project_id=352488bb649b45819bed25de31f1156f, group_id=a124381d3f514d8aa9d4294cf849a74c, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:30.194385 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabd8b9-7854-4e5a-b221-46af93ab3df2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:30.220612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 190/387] 10.222.0.13 () {58 vars in 1442 bytes} [Mon Jun 20 05:54:30 2022] PUT /identity/v3/projects/352488bb649b45819bed25de31f1156f/groups/a124381d3f514d8aa9d4294cf849a74c/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:54:30.502381 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31ae13-60e6-4a6d-99cb-fb6f35ce2f11 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:30.502590 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31ae13-60e6-4a6d-99cb-fb6f35ce2f11 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:30.502857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31ae13-60e6-4a6d-99cb-fb6f35ce2f11 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:30.504530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 198/388] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:30.509825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1d6de-156e-4cda-9da7-a7568048c7b8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:30.510441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1d6de-156e-4cda-9da7-a7568048c7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:30.510441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1d6de-156e-4cda-9da7-a7568048c7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:30.534324 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-75f1d6de-156e-4cda-9da7-a7568048c7b8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:30.535547 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-75f1d6de-156e-4cda-9da7-a7568048c7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:30.584047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:30.623300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 191/389] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:30.647814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31ae13-60e6-4a6d-99cb-fb6f35ce2f11 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:30.666087 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68efb31-812c-4480-ab20-bc7997afb766 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:30.666404 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68efb31-812c-4480-ab20-bc7997afb766 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:30.666661 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68efb31-812c-4480-ab20-bc7997afb766 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:30.668189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 192/390] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:54:30.673337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:30.675998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87a96-96c9-4e6f-bdc3-21b7d2da21e8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:30.676289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87a96-96c9-4e6f-bdc3-21b7d2da21e8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:30.676712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87a96-96c9-4e6f-bdc3-21b7d2da21e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:30.696844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a8b87a96-96c9-4e6f-bdc3-21b7d2da21e8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:30.698568 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a8b87a96-96c9-4e6f-bdc3-21b7d2da21e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:30.777327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31ae13-60e6-4a6d-99cb-fb6f35ce2f11 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:30.822460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 193/391] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:30.843448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42571b-4336-4b00-84db-ce2afb8eeb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:30.844259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42571b-4336-4b00-84db-ce2afb8eeb3c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:30.844576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42571b-4336-4b00-84db-ce2afb8eeb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:30.844857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42571b-4336-4b00-84db-ce2afb8eeb3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:30.850629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87a96-96c9-4e6f-bdc3-21b7d2da21e8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:30.880261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42571b-4336-4b00-84db-ce2afb8eeb3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-7c42571b-4336-4b00-84db-ce2afb8eeb3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:30.888249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:30.889149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:30.889933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 199/392] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:30.905866 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42571b-4336-4b00-84db-ce2afb8eeb3c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:31.049698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87a96-96c9-4e6f-bdc3-21b7d2da21e8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:31.051199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:31.080658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:31.124527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42571b-4336-4b00-84db-ce2afb8eeb3c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:31.134760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17843cd6-12b2-4b7c-b95d-9d772317836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:31.135582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17843cd6-12b2-4b7c-b95d-9d772317836b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:31.135860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17843cd6-12b2-4b7c-b95d-9d772317836b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:31.136131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17843cd6-12b2-4b7c-b95d-9d772317836b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:31.161784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17843cd6-12b2-4b7c-b95d-9d772317836b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-17843cd6-12b2-4b7c-b95d-9d772317836b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:31.178937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:31.179918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:31.181095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 194/393] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:54:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:31.188468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17843cd6-12b2-4b7c-b95d-9d772317836b None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:31.195978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba9be5-4574-45a9-93e1-496756fc8f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:31.197609 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba9be5-4574-45a9-93e1-496756fc8f47 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:31.197894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba9be5-4574-45a9-93e1-496756fc8f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:31.198168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba9be5-4574-45a9-93e1-496756fc8f47 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:31.198931 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba9be5-4574-45a9-93e1-496756fc8f47 None admin] RBAC: Adding query filter params (name=member) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:31.199240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba9be5-4574-45a9-93e1-496756fc8f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:31.200658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba9be5-4574-45a9-93e1-496756fc8f47 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:31.223929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 200/394] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:31.234084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba9be5-4574-45a9-93e1-496756fc8f47 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:31.375173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba9be5-4574-45a9-93e1-496756fc8f47 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:31.379375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17843cd6-12b2-4b7c-b95d-9d772317836b None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:31.415578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8779f-45ad-426c-a659-58ee8a16f857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:31.416513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8779f-45ad-426c-a659-58ee8a16f857 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:31.416796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8779f-45ad-426c-a659-58ee8a16f857 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:31.417069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8779f-45ad-426c-a659-58ee8a16f857 None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:31.418390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8779f-45ad-426c-a659-58ee8a16f857 None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:31.419983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8779f-45ad-426c-a659-58ee8a16f857 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:31.421892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 201/395] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:31 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:31.433926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0fc78-b7c7-4306-9a09-af2da2412a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:31.434603 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fc78-b7c7-4306-9a09-af2da2412a19 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:31.434892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fc78-b7c7-4306-9a09-af2da2412a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:31.435166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fc78-b7c7-4306-9a09-af2da2412a19 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:31.435921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0fc78-b7c7-4306-9a09-af2da2412a19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:31.436231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0fc78-b7c7-4306-9a09-af2da2412a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:31.437631 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0fc78-b7c7-4306-9a09-af2da2412a19 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:31.446888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 195/396] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:31.448800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8779f-45ad-426c-a659-58ee8a16f857 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:31.461236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:31.464303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0fc78-b7c7-4306-9a09-af2da2412a19 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:31.504368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:31.573194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8779f-45ad-426c-a659-58ee8a16f857 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:31.603592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0fc78-b7c7-4306-9a09-af2da2412a19 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:31.610110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c1d1e-981a-417a-aa60-bf74aec52002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:31.611106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c1d1e-981a-417a-aa60-bf74aec52002 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:31.611441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c1d1e-981a-417a-aa60-bf74aec52002 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:31.611725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c1d1e-981a-417a-aa60-bf74aec52002 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:31.613071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c1d1e-981a-417a-aa60-bf74aec52002 None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:31.614689 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c1d1e-981a-417a-aa60-bf74aec52002 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:31.616840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 202/397] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:31 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:31.637274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c1d1e-981a-417a-aa60-bf74aec52002 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:31.649648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c80fbc-850d-4be3-a929-5ca807b67ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:31.650507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c80fbc-850d-4be3-a929-5ca807b67ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:31.650787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c80fbc-850d-4be3-a929-5ca807b67ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:31.651322 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c80fbc-850d-4be3-a929-5ca807b67ce5 None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:31.652533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c80fbc-850d-4be3-a929-5ca807b67ce5 None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:31.654023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c80fbc-850d-4be3-a929-5ca807b67ce5 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:31.655660 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 196/398] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:31 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:31.663101 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c80fbc-850d-4be3-a929-5ca807b67ce5 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:31.785049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:31.816798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:31.824435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c80fbc-850d-4be3-a929-5ca807b67ce5 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:31.846461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c1d1e-981a-417a-aa60-bf74aec52002 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:31.859927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f2af7-d0fb-4c5c-8872-2f8f96eeb4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:31.860832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f2af7-d0fb-4c5c-8872-2f8f96eeb4ce None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:31.864370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f2af7-d0fb-4c5c-8872-2f8f96eeb4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:31.864370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f2af7-d0fb-4c5c-8872-2f8f96eeb4ce None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:31.864370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f2af7-d0fb-4c5c-8872-2f8f96eeb4ce None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:31.864370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f2af7-d0fb-4c5c-8872-2f8f96eeb4ce None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:31.866129 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 197/399] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:31 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:31.872384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f2af7-d0fb-4c5c-8872-2f8f96eeb4ce None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:31.920138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d05a6e-f376-4fb4-90f8-47d78f8f1568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:31.921070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d05a6e-f376-4fb4-90f8-47d78f8f1568 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:31.921357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d05a6e-f376-4fb4-90f8-47d78f8f1568 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:31.921639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d05a6e-f376-4fb4-90f8-47d78f8f1568 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/groups/a124381d3f514d8aa9d4294cf849a74c/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:31.923724 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d05a6e-f376-4fb4-90f8-47d78f8f1568 None admin] RBAC: Authorizing `identity:create_grant(project_id=7761a3e3dfee4860bce7efebb2025a4b, group_id=a124381d3f514d8aa9d4294cf849a74c, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:31.925198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d05a6e-f376-4fb4-90f8-47d78f8f1568 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:31.952526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 203/400] 10.222.0.13 () {58 vars in 1442 bytes} [Mon Jun 20 05:54:31 2022] PUT /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/groups/a124381d3f514d8aa9d4294cf849a74c/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:54:32.003545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f2af7-d0fb-4c5c-8872-2f8f96eeb4ce None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:32.043177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f05b8-91d9-42c1-b59c-deb4366297c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:32.044075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f05b8-91d9-42c1-b59c-deb4366297c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:32.044388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f05b8-91d9-42c1-b59c-deb4366297c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:32.044673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f05b8-91d9-42c1-b59c-deb4366297c0 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f/groups/a124381d3f514d8aa9d4294cf849a74c/roles/5cdb558ab7044154896c8f9e3dfba431` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:32.046974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f05b8-91d9-42c1-b59c-deb4366297c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=352488bb649b45819bed25de31f1156f, group_id=a124381d3f514d8aa9d4294cf849a74c, role_id=5cdb558ab7044154896c8f9e3dfba431)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:32.048459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f05b8-91d9-42c1-b59c-deb4366297c0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:32.065463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 198/401] 10.222.0.13 () {58 vars in 1442 bytes} [Mon Jun 20 05:54:31 2022] PUT /identity/v3/projects/352488bb649b45819bed25de31f1156f/groups/a124381d3f514d8aa9d4294cf849a74c/roles/5cdb558ab7044154896c8f9e3dfba431 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:54:32.172701 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27676e5-ffcc-49f0-b720-819f165a7ddf None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:32.173033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27676e5-ffcc-49f0-b720-819f165a7ddf None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:32.173324 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27676e5-ffcc-49f0-b720-819f165a7ddf None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:32.174781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 204/402] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:32.181864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1460-fc52-4db2-a5dc-8d539b547f79 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:32.182182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1460-fc52-4db2-a5dc-8d539b547f79 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:32.182434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1460-fc52-4db2-a5dc-8d539b547f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:32.204347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-646b1460-fc52-4db2-a5dc-8d539b547f79 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:32.206546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-646b1460-fc52-4db2-a5dc-8d539b547f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:32.223549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:32.285011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 199/403] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:32.311303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27676e5-ffcc-49f0-b720-819f165a7ddf None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:32.455906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27676e5-ffcc-49f0-b720-819f165a7ddf None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:32.502983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f6c9d-eba7-495d-8be6-b2f8f40f50da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:32.503835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6c9d-eba7-495d-8be6-b2f8f40f50da None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:32.504122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6c9d-eba7-495d-8be6-b2f8f40f50da None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:32.504424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6c9d-eba7-495d-8be6-b2f8f40f50da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:32.506388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:32.520304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f6c9d-eba7-495d-8be6-b2f8f40f50da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-8c5f6c9d-eba7-495d-8be6-b2f8f40f50da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:32.534980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:32.535921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:32.536740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 205/404] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:54:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:32.543749 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b1460-fc52-4db2-a5dc-8d539b547f79 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:32.567610 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ef4c-8436-4a40-a934-4de462eba71c None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:32.567944 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ef4c-8436-4a40-a934-4de462eba71c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:32.568167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ef4c-8436-4a40-a934-4de462eba71c None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:32.569595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 206/405] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:54:32.574801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd06b09-4365-4615-b50f-44337887b3ef None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:32.575090 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd06b09-4365-4615-b50f-44337887b3ef None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:32.575371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd06b09-4365-4615-b50f-44337887b3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:32.594386 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5fd06b09-4365-4615-b50f-44337887b3ef None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:32.595602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5fd06b09-4365-4615-b50f-44337887b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:32.674315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 207/406] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:32.711698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd06b09-4365-4615-b50f-44337887b3ef None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:32.755329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b1460-fc52-4db2-a5dc-8d539b547f79 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:32.797517 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49727ed8-4d9f-4f2c-80a9-58a5601a62aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:32.798188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49727ed8-4d9f-4f2c-80a9-58a5601a62aa None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:32.798467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49727ed8-4d9f-4f2c-80a9-58a5601a62aa None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:32.798738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49727ed8-4d9f-4f2c-80a9-58a5601a62aa None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:32.799512 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49727ed8-4d9f-4f2c-80a9-58a5601a62aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:32.799796 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49727ed8-4d9f-4f2c-80a9-58a5601a62aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:32.801219 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49727ed8-4d9f-4f2c-80a9-58a5601a62aa None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:32.810321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 200/407] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:32.815481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49727ed8-4d9f-4f2c-80a9-58a5601a62aa None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:32.832361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:32.932508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd06b09-4365-4615-b50f-44337887b3ef None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:32.962045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:32.967797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49727ed8-4d9f-4f2c-80a9-58a5601a62aa None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:32.982802 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aac3e-bd06-4446-a9ef-5e92049795cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:32.983622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aac3e-bd06-4446-a9ef-5e92049795cb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:32.983904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aac3e-bd06-4446-a9ef-5e92049795cb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:32.984178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604aac3e-bd06-4446-a9ef-5e92049795cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:33.002227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0f21a-22c4-4714-8014-808ca162f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:33.003091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f21a-22c4-4714-8014-808ca162f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:33.003371 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f21a-22c4-4714-8014-808ca162f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:33.003648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0f21a-22c4-4714-8014-808ca162f4a2 None admin] PATH_INFO: `/v3/groups/ca15336ce76d4f659bfb1ef5269991b8` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:33.004467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604aac3e-bd06-4446-a9ef-5e92049795cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:33.004870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0f21a-22c4-4714-8014-808ca162f4a2 None admin] RBAC: Authorizing `identity:get_group(group_id=ca15336ce76d4f659bfb1ef5269991b8)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:33.006304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0f21a-22c4-4714-8014-808ca162f4a2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:33.008792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 201/408] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:32 2022] GET /identity/v3/groups/ca15336ce76d4f659bfb1ef5269991b8 => generated 229 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:33.014859 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0f21a-22c4-4714-8014-808ca162f4a2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-604aac3e-bd06-4446-a9ef-5e92049795cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:33.023703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:33.024660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:33.025443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 208/409] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:54:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:33.034019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aac3e-bd06-4446-a9ef-5e92049795cb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:33.136798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:33.154581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0f21a-22c4-4714-8014-808ca162f4a2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:33.166767 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604aac3e-bd06-4446-a9ef-5e92049795cb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:33.188654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425beb2a-6e17-47a1-87cb-984f007074b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:33.189524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425beb2a-6e17-47a1-87cb-984f007074b9 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:33.189806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425beb2a-6e17-47a1-87cb-984f007074b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:33.190079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425beb2a-6e17-47a1-87cb-984f007074b9 None admin] PATH_INFO: `/v3/projects/0a570b43b29a48ed93337d06e7d2c924` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:33.191277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425beb2a-6e17-47a1-87cb-984f007074b9 None admin] RBAC: Authorizing `identity:get_project(project_id=0a570b43b29a48ed93337d06e7d2c924)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:33.192776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425beb2a-6e17-47a1-87cb-984f007074b9 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:33.195131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 202/410] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:33 2022] GET /identity/v3/projects/0a570b43b29a48ed93337d06e7d2c924 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:33.196440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ac7a-4405-4dd5-b153-1176f1821a50 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:33.196780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ac7a-4405-4dd5-b153-1176f1821a50 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:33.197060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ac7a-4405-4dd5-b153-1176f1821a50 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:33.202445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 203/411] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:33.203349 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3ac7a-4405-4dd5-b153-1176f1821a50 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:33.207807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a5377-a52c-45da-b522-8ae7a10cd050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:33.208745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a5377-a52c-45da-b522-8ae7a10cd050 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:33.209229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a5377-a52c-45da-b522-8ae7a10cd050 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:33.209717 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a5377-a52c-45da-b522-8ae7a10cd050 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:33.210835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a5377-a52c-45da-b522-8ae7a10cd050 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:33.211365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a5377-a52c-45da-b522-8ae7a10cd050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:33.213129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a5377-a52c-45da-b522-8ae7a10cd050 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:33.222411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 209/412] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:33.223931 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8574b-decd-481b-8d5b-f68f4e33c555 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:33.224473 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8574b-decd-481b-8d5b-f68f4e33c555 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:33.224976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8574b-decd-481b-8d5b-f68f4e33c555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:33.245921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-eda8574b-decd-481b-8d5b-f68f4e33c555 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:33.247424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-eda8574b-decd-481b-8d5b-f68f4e33c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:33.299943 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:33.307450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3ac7a-4405-4dd5-b153-1176f1821a50 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:33.330520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 210/413] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:33.331717 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8574b-decd-481b-8d5b-f68f4e33c555 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:33.357591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f484b-eca6-4ee0-8cc0-3da8ba775f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:33.358628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f484b-eca6-4ee0-8cc0-3da8ba775f29 None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:33.358811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f484b-eca6-4ee0-8cc0-3da8ba775f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:33.359056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f484b-eca6-4ee0-8cc0-3da8ba775f29 None admin] PATH_INFO: `/v3/projects/0a570b43b29a48ed93337d06e7d2c924/groups/ca15336ce76d4f659bfb1ef5269991b8/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:33.365337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f484b-eca6-4ee0-8cc0-3da8ba775f29 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a570b43b29a48ed93337d06e7d2c924, group_id=ca15336ce76d4f659bfb1ef5269991b8, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:33.367374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f484b-eca6-4ee0-8cc0-3da8ba775f29 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:33.387217 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 204/414] 10.222.0.13 () {58 vars in 1442 bytes} [Mon Jun 20 05:54:33 2022] PUT /identity/v3/projects/0a570b43b29a48ed93337d06e7d2c924/groups/ca15336ce76d4f659bfb1ef5269991b8/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:54:33.387801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f484b-eca6-4ee0-8cc0-3da8ba775f29 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:33.399488 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:33.491609 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8574b-decd-481b-8d5b-f68f4e33c555 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:33.500823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f484b-eca6-4ee0-8cc0-3da8ba775f29 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:33.539095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62180c3b-47ac-4d9d-a550-3df20f4d59f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:33.539893 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180c3b-47ac-4d9d-a550-3df20f4d59f2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:33.540179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180c3b-47ac-4d9d-a550-3df20f4d59f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:33.540500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62180c3b-47ac-4d9d-a550-3df20f4d59f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:33.552248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62180c3b-47ac-4d9d-a550-3df20f4d59f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-62180c3b-47ac-4d9d-a550-3df20f4d59f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:33.561128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:33.562058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:33.562860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 205/415] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:33.568266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62180c3b-47ac-4d9d-a550-3df20f4d59f2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:33.568996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39ab5c-7586-45eb-ae56-d105338f1425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:33.570253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39ab5c-7586-45eb-ae56-d105338f1425 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:33.570741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39ab5c-7586-45eb-ae56-d105338f1425 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:33.571211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39ab5c-7586-45eb-ae56-d105338f1425 None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:33.572642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39ab5c-7586-45eb-ae56-d105338f1425 None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:33.574298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39ab5c-7586-45eb-ae56-d105338f1425 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:33.576150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 211/416] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:33 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:33.585370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39ab5c-7586-45eb-ae56-d105338f1425 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:33.644786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:33.671065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:33.705228 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62180c3b-47ac-4d9d-a550-3df20f4d59f2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:33.740188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323bf59-6f55-4321-a67f-f73df960ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:33.741027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323bf59-6f55-4321-a67f-f73df960ab53 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:33.741203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323bf59-6f55-4321-a67f-f73df960ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:33.741422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323bf59-6f55-4321-a67f-f73df960ab53 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:33.742293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323bf59-6f55-4321-a67f-f73df960ab53 None admin] RBAC: Adding query filter params (name=member) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:33.742548 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323bf59-6f55-4321-a67f-f73df960ab53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:33.743919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323bf59-6f55-4321-a67f-f73df960ab53 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:33.751544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39ab5c-7586-45eb-ae56-d105338f1425 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:33.756092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 206/417] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:33.763095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323bf59-6f55-4321-a67f-f73df960ab53 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:33.791870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82713c-9fee-4709-966e-1b2229a36d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:33.792761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82713c-9fee-4709-966e-1b2229a36d73 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:33.793038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82713c-9fee-4709-966e-1b2229a36d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:33.793342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82713c-9fee-4709-966e-1b2229a36d73 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:33.795184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82713c-9fee-4709-966e-1b2229a36d73 None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:33.796826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82713c-9fee-4709-966e-1b2229a36d73 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:33.799429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 212/418] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:33 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:33.805729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82713c-9fee-4709-966e-1b2229a36d73 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:33.925964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323bf59-6f55-4321-a67f-f73df960ab53 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:33.972000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:33.974642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82713c-9fee-4709-966e-1b2229a36d73 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:33.985534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679ffb3-8e04-4f60-937e-499c549d7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:33.986203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679ffb3-8e04-4f60-937e-499c549d7418 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:33.986494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679ffb3-8e04-4f60-937e-499c549d7418 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:33.986778 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679ffb3-8e04-4f60-937e-499c549d7418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:34.003013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:34.041745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151225b5-74a8-4487-bbd4-708706b52634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:34.042635 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151225b5-74a8-4487-bbd4-708706b52634 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:34.042918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151225b5-74a8-4487-bbd4-708706b52634 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:34.043192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151225b5-74a8-4487-bbd4-708706b52634 None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/groups/a124381d3f514d8aa9d4294cf849a74c/roles/5cdb558ab7044154896c8f9e3dfba431` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:34.047736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151225b5-74a8-4487-bbd4-708706b52634 None admin] RBAC: Authorizing `identity:create_grant(project_id=7761a3e3dfee4860bce7efebb2025a4b, group_id=a124381d3f514d8aa9d4294cf849a74c, role_id=5cdb558ab7044154896c8f9e3dfba431)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:34.049520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151225b5-74a8-4487-bbd4-708706b52634 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:34.076352 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 213/419] 10.222.0.13 () {58 vars in 1442 bytes} [Mon Jun 20 05:54:33 2022] PUT /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b/groups/a124381d3f514d8aa9d4294cf849a74c/roles/5cdb558ab7044154896c8f9e3dfba431 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:54:34.100408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679ffb3-8e04-4f60-937e-499c549d7418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:34.101994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679ffb3-8e04-4f60-937e-499c549d7418 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:34.214725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 207/420] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:34.224768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151225b5-74a8-4487-bbd4-708706b52634 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:34.363838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151225b5-74a8-4487-bbd4-708706b52634 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:34.393756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3bd3-0390-42aa-8c44-5c1a3c4a8d0b None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:34.394038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3bd3-0390-42aa-8c44-5c1a3c4a8d0b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:34.394309 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e3bd3-0390-42aa-8c44-5c1a3c4a8d0b None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:34.395679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 208/421] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:54:34.402780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97cf35-e0cb-4073-870f-24359533c408 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:34.403066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97cf35-e0cb-4073-870f-24359533c408 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:34.403390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97cf35-e0cb-4073-870f-24359533c408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:34.416060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2967e35-ec89-4b89-87eb-844b6f5237cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:34.417290 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2967e35-ec89-4b89-87eb-844b6f5237cb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:34.417771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2967e35-ec89-4b89-87eb-844b6f5237cb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:34.418255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2967e35-ec89-4b89-87eb-844b6f5237cb None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:34.419675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2967e35-ec89-4b89-87eb-844b6f5237cb None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:34.421413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2967e35-ec89-4b89-87eb-844b6f5237cb None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:34.422569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-5c97cf35-e0cb-4073-870f-24359533c408 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:34.423746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5c97cf35-e0cb-4073-870f-24359533c408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:34.424148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 214/422] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:34 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:34.430885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2967e35-ec89-4b89-87eb-844b6f5237cb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:34.478939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:34.480683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:34.545633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2967e35-ec89-4b89-87eb-844b6f5237cb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:34.583092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dbc23-437b-4a54-a7f8-ac8ca045859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:34.584093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dbc23-437b-4a54-a7f8-ac8ca045859f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:34.584505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dbc23-437b-4a54-a7f8-ac8ca045859f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:34.584882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814dbc23-437b-4a54-a7f8-ac8ca045859f None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:34.586188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dbc23-437b-4a54-a7f8-ac8ca045859f None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:34.587811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814dbc23-437b-4a54-a7f8-ac8ca045859f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:34.588506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 209/423] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:34.589729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 215/424] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:34 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:34.595377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97cf35-e0cb-4073-870f-24359533c408 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:34.614047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dbc23-437b-4a54-a7f8-ac8ca045859f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:34.726915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97cf35-e0cb-4073-870f-24359533c408 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:34.730786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814dbc23-437b-4a54-a7f8-ac8ca045859f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:34.740627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:34.768030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bf5c8-c8f5-4c9c-91ce-9269c3fcecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:34.768948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf5c8-c8f5-4c9c-91ce-9269c3fcecfb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:34.769575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf5c8-c8f5-4c9c-91ce-9269c3fcecfb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:34.769671 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf5c8-c8f5-4c9c-91ce-9269c3fcecfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:34.769953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03970831-6ad5-40b6-8d42-a40d642e01eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:34.770844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970831-6ad5-40b6-8d42-a40d642e01eb None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:34.771195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970831-6ad5-40b6-8d42-a40d642e01eb None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:34.771535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970831-6ad5-40b6-8d42-a40d642e01eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:34.772650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03970831-6ad5-40b6-8d42-a40d642e01eb None admin] RBAC: Adding query filter params (group.id=a124381d3f514d8aa9d4294cf849a74c, role.id=9734fe47b63747daa9141041f1723e55, scope.project.id=352488bb649b45819bed25de31f1156f) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:34.773319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03970831-6ad5-40b6-8d42-a40d642e01eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:34.774768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03970831-6ad5-40b6-8d42-a40d642e01eb None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:34.782933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bf5c8-c8f5-4c9c-91ce-9269c3fcecfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:34.783641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 210/425] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 20 05:54:34 2022] GET /identity/v3/role_assignments?group.id=a124381d3f514d8aa9d4294cf849a74c&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=9734fe47b63747daa9141041f1723e55 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:34.785170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248986b6-0bcd-43ea-82c9-e0c863bea4e9 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:34.785665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248986b6-0bcd-43ea-82c9-e0c863bea4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:34.786151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248986b6-0bcd-43ea-82c9-e0c863bea4e9 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c73bf5c8-c8f5-4c9c-91ce-9269c3fcecfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:34.791868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:34.792892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:34.793676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 216/427] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:34.794559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb470dca-f346-4047-bfd2-b03b7f0e9c96 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:34.794687 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 211/427] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:34.794781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb470dca-f346-4047-bfd2-b03b7f0e9c96 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:34.800436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb470dca-f346-4047-bfd2-b03b7f0e9c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:34.800638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248986b6-0bcd-43ea-82c9-e0c863bea4e9 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:34.832763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:34.834260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cb470dca-f346-4047-bfd2-b03b7f0e9c96 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:34.836074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cb470dca-f346-4047-bfd2-b03b7f0e9c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:34.970784 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 217/428] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:34.973582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248986b6-0bcd-43ea-82c9-e0c863bea4e9 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:34.996877 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb470dca-f346-4047-bfd2-b03b7f0e9c96 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:35.014972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf415b-4e25-48c9-a10e-bc86702b4e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:35.015960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf415b-4e25-48c9-a10e-bc86702b4e90 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:35.016420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf415b-4e25-48c9-a10e-bc86702b4e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:35.016895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf415b-4e25-48c9-a10e-bc86702b4e90 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:35.017910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf415b-4e25-48c9-a10e-bc86702b4e90 None admin] RBAC: Adding query filter params (name=member) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:35.018590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf415b-4e25-48c9-a10e-bc86702b4e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:35.020172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf415b-4e25-48c9-a10e-bc86702b4e90 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:35.031596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 212/429] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:54:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:35.037179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf415b-4e25-48c9-a10e-bc86702b4e90 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:35.136157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:35.141587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb470dca-f346-4047-bfd2-b03b7f0e9c96 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:35.143871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:35.161881 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf415b-4e25-48c9-a10e-bc86702b4e90 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:35.190697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64db71-9111-4d97-b3de-ea8ff3ecdec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:35.192432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64db71-9111-4d97-b3de-ea8ff3ecdec7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:35.192870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64db71-9111-4d97-b3de-ea8ff3ecdec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:35.193533 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64db71-9111-4d97-b3de-ea8ff3ecdec7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:35.204501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb1f68-6056-4c54-a539-272fe1eba3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:35.205161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb1f68-6056-4c54-a539-272fe1eba3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:35.205444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb1f68-6056-4c54-a539-272fe1eba3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:35.205721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb1f68-6056-4c54-a539-272fe1eba3c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:35.207684 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64db71-9111-4d97-b3de-ea8ff3ecdec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-9f64db71-9111-4d97-b3de-ea8ff3ecdec7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:35.218411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:35.219536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:35.220617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:35.223395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 218/430] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:54:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:35.232754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64db71-9111-4d97-b3de-ea8ff3ecdec7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:35.313092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb1f68-6056-4c54-a539-272fe1eba3c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:35.314509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb1f68-6056-4c54-a539-272fe1eba3c8 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:35.375638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64db71-9111-4d97-b3de-ea8ff3ecdec7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:35.415807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee891eaa-9493-4d87-8880-ab0c0d2897d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:35.416504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee891eaa-9493-4d87-8880-ab0c0d2897d1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:35.416788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee891eaa-9493-4d87-8880-ab0c0d2897d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:35.417075 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee891eaa-9493-4d87-8880-ab0c0d2897d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:35.417883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee891eaa-9493-4d87-8880-ab0c0d2897d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:35.418373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee891eaa-9493-4d87-8880-ab0c0d2897d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:35.420887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee891eaa-9493-4d87-8880-ab0c0d2897d1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:35.422083 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:35.437393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 219/431] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:35.438640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee891eaa-9493-4d87-8880-ab0c0d2897d1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:35.451161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 213/432] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:35.456708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb1f68-6056-4c54-a539-272fe1eba3c8 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:35.467543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:35.566865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee891eaa-9493-4d87-8880-ab0c0d2897d1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:35.595998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb1f68-6056-4c54-a539-272fe1eba3c8 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:35.611160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5d019-228b-41e1-9453-81101200ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:35.612148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5d019-228b-41e1-9453-81101200ab46 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:35.612694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5d019-228b-41e1-9453-81101200ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:35.613191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5d019-228b-41e1-9453-81101200ab46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:35.644939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c6ca4-7e20-4e94-890f-9c8ccbee252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:35.646034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c6ca4-7e20-4e94-890f-9c8ccbee252e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:35.646458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c6ca4-7e20-4e94-890f-9c8ccbee252e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:35.646737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c6ca4-7e20-4e94-890f-9c8ccbee252e None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:35.648085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c6ca4-7e20-4e94-890f-9c8ccbee252e None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:35.649561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c6ca4-7e20-4e94-890f-9c8ccbee252e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:35.651517 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 214/433] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:35 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:35.658333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c6ca4-7e20-4e94-890f-9c8ccbee252e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:35.701202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5d019-228b-41e1-9453-81101200ab46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:35.702935 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5d019-228b-41e1-9453-81101200ab46 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:35.724416 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:35.726171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:35.775041 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c6ca4-7e20-4e94-890f-9c8ccbee252e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:35.809885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 220/434] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:35.815371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5d019-228b-41e1-9453-81101200ab46 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:35.818558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af357b60-50e1-4d1a-9b01-39a219f86f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:35.819648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af357b60-50e1-4d1a-9b01-39a219f86f11 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:35.820175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af357b60-50e1-4d1a-9b01-39a219f86f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:35.820674 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af357b60-50e1-4d1a-9b01-39a219f86f11 None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:35.822048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af357b60-50e1-4d1a-9b01-39a219f86f11 None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:35.823841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af357b60-50e1-4d1a-9b01-39a219f86f11 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:35.830639 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 215/435] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:35 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:35.831847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af357b60-50e1-4d1a-9b01-39a219f86f11 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:35.920008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5d019-228b-41e1-9453-81101200ab46 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:35.938673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af357b60-50e1-4d1a-9b01-39a219f86f11 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:35.941733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:35.958006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14b1a5-a5a1-4148-8ba2-cfef58073b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:35.958853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b1a5-a5a1-4148-8ba2-cfef58073b06 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:35.959132 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b1a5-a5a1-4148-8ba2-cfef58073b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:35.959405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14b1a5-a5a1-4148-8ba2-cfef58073b06 None admin] PATH_INFO: `/v3/projects/352488bb649b45819bed25de31f1156f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:35.960757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14b1a5-a5a1-4148-8ba2-cfef58073b06 None admin] RBAC: Authorizing `identity:get_project(project_id=352488bb649b45819bed25de31f1156f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:35.962196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14b1a5-a5a1-4148-8ba2-cfef58073b06 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:35.963872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:35.964220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 221/436] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:35 2022] GET /identity/v3/projects/352488bb649b45819bed25de31f1156f => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:35.965486 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d7ce6-0ec1-42f4-ae61-a4a089691567 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:35.965766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d7ce6-0ec1-42f4-ae61-a4a089691567 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:35.966036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d7ce6-0ec1-42f4-ae61-a4a089691567 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:35.967393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 222/437] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:35.972331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d7ce6-0ec1-42f4-ae61-a4a089691567 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:35.980644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254679ec-8e49-44f5-89df-30c953fcd23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:35.981305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254679ec-8e49-44f5-89df-30c953fcd23c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:35.981862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254679ec-8e49-44f5-89df-30c953fcd23c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:35.981862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254679ec-8e49-44f5-89df-30c953fcd23c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:35.982710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254679ec-8e49-44f5-89df-30c953fcd23c None admin] RBAC: Adding query filter params (group.id=a124381d3f514d8aa9d4294cf849a74c, role.id=9734fe47b63747daa9141041f1723e55, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:35.983026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254679ec-8e49-44f5-89df-30c953fcd23c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:35.984486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254679ec-8e49-44f5-89df-30c953fcd23c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:36.000344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 216/438] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 20 05:54:35 2022] GET /identity/v3/role_assignments?group.id=a124381d3f514d8aa9d4294cf849a74c&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=9734fe47b63747daa9141041f1723e55 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:36.000344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46eaf7-b0c5-47f5-a710-fe04ed751d93 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:36.000344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46eaf7-b0c5-47f5-a710-fe04ed751d93 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:36.000344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46eaf7-b0c5-47f5-a710-fe04ed751d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:36.023645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-ef46eaf7-b0c5-47f5-a710-fe04ed751d93 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:36.024915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ef46eaf7-b0c5-47f5-a710-fe04ed751d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:36.107246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d7ce6-0ec1-42f4-ae61-a4a089691567 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:36.114359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 217/439] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:36.138526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46eaf7-b0c5-47f5-a710-fe04ed751d93 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:36.149641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad5f2e-f9ef-48ee-aaac-2c595c5338bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:36.151233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5f2e-f9ef-48ee-aaac-2c595c5338bd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:36.151514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5f2e-f9ef-48ee-aaac-2c595c5338bd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:36.151785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad5f2e-f9ef-48ee-aaac-2c595c5338bd None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:36.153481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad5f2e-f9ef-48ee-aaac-2c595c5338bd None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:36.155071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad5f2e-f9ef-48ee-aaac-2c595c5338bd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:36.157679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 223/440] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:35 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:36.163467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad5f2e-f9ef-48ee-aaac-2c595c5338bd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:36.239537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:36.271927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46eaf7-b0c5-47f5-a710-fe04ed751d93 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:36.287729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad5f2e-f9ef-48ee-aaac-2c595c5338bd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:36.289820 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:36.309793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e5299-bcbb-4dee-82c1-dc76e3a33fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:36.310588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e5299-bcbb-4dee-82c1-dc76e3a33fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:36.310878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e5299-bcbb-4dee-82c1-dc76e3a33fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:36.311156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e5299-bcbb-4dee-82c1-dc76e3a33fe9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:36.321475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e5299-bcbb-4dee-82c1-dc76e3a33fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:36.322846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171381-cd4e-4c4f-bd51-ab158d398a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:36.323490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171381-cd4e-4c4f-bd51-ab158d398a50 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:36.323771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171381-cd4e-4c4f-bd51-ab158d398a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:36.324046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171381-cd4e-4c4f-bd51-ab158d398a50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:36.324909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171381-cd4e-4c4f-bd51-ab158d398a50 None admin] RBAC: Adding query filter params (group.id=a124381d3f514d8aa9d4294cf849a74c, role.id=5cdb558ab7044154896c8f9e3dfba431, scope.project.id=352488bb649b45819bed25de31f1156f) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:36.325221 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171381-cd4e-4c4f-bd51-ab158d398a50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:36.326641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171381-cd4e-4c4f-bd51-ab158d398a50 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-505e5299-bcbb-4dee-82c1-dc76e3a33fe9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:36.329153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:36.330049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:36.330841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 218/441] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:54:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:36.336839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e5299-bcbb-4dee-82c1-dc76e3a33fe9 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:36.344699 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 224/442] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 20 05:54:36 2022] GET /identity/v3/role_assignments?group.id=a124381d3f514d8aa9d4294cf849a74c&scope.project.id=352488bb649b45819bed25de31f1156f&role.id=5cdb558ab7044154896c8f9e3dfba431 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:36.448340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e5299-bcbb-4dee-82c1-dc76e3a33fe9 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:36.484072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e4643-504d-4d06-a6ce-81481e3680c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:36.484774 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e4643-504d-4d06-a6ce-81481e3680c4 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:36.485795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e4643-504d-4d06-a6ce-81481e3680c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:36.485795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e4643-504d-4d06-a6ce-81481e3680c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:36.486082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e4643-504d-4d06-a6ce-81481e3680c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:36.486938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e4643-504d-4d06-a6ce-81481e3680c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:36.487756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e4643-504d-4d06-a6ce-81481e3680c4 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:36.496977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 219/443] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:36.502664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171381-cd4e-4c4f-bd51-ab158d398a50 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:36.503765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85e339-5810-4a8d-b48d-492396b62224 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:36.504059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85e339-5810-4a8d-b48d-492396b62224 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:36.504366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85e339-5810-4a8d-b48d-492396b62224 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:36.505706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 220/444] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:36.510606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40789c50-574c-47eb-9dfa-f9c0ba47896f None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:36.510892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40789c50-574c-47eb-9dfa-f9c0ba47896f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:36.511173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40789c50-574c-47eb-9dfa-f9c0ba47896f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:36.528645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-40789c50-574c-47eb-9dfa-f9c0ba47896f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:36.530053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-40789c50-574c-47eb-9dfa-f9c0ba47896f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:36.564821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:36.605337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 221/445] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:36.622462 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171381-cd4e-4c4f-bd51-ab158d398a50 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:36.628623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40789c50-574c-47eb-9dfa-f9c0ba47896f None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:36.647268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:36.664228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459e136-3d65-401d-a2f8-181218816316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:36.665217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e136-3d65-401d-a2f8-181218816316 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:36.665502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e136-3d65-401d-a2f8-181218816316 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:36.666483 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459e136-3d65-401d-a2f8-181218816316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:36.743608 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40789c50-574c-47eb-9dfa-f9c0ba47896f None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:36.747870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459e136-3d65-401d-a2f8-181218816316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:36.749374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459e136-3d65-401d-a2f8-181218816316 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:36.786391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f72f6-9e82-431e-a43f-6dc79f1d28ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:36.787198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f72f6-9e82-431e-a43f-6dc79f1d28ad None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:36.787486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f72f6-9e82-431e-a43f-6dc79f1d28ad None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:36.787757 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f72f6-9e82-431e-a43f-6dc79f1d28ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:36.800990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f72f6-9e82-431e-a43f-6dc79f1d28ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-9a5f72f6-9e82-431e-a43f-6dc79f1d28ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:36.809634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:36.810556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:36.811345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 222/446] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:54:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:36.817828 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f72f6-9e82-431e-a43f-6dc79f1d28ad None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:36.853744 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:36.866167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 225/447] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:36.872304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459e136-3d65-401d-a2f8-181218816316 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:36.892181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:36.925768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f72f6-9e82-431e-a43f-6dc79f1d28ad None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:36.959520 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e75af-5734-4872-9b00-d13247f108af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:36.960170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e75af-5734-4872-9b00-d13247f108af None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:36.960612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e75af-5734-4872-9b00-d13247f108af None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:36.960894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e75af-5734-4872-9b00-d13247f108af None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:36.961637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e75af-5734-4872-9b00-d13247f108af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:36.961942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e75af-5734-4872-9b00-d13247f108af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:36.963306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e75af-5734-4872-9b00-d13247f108af None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:36.968717 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459e136-3d65-401d-a2f8-181218816316 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:36.970953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 223/448] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:36.976966 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e75af-5734-4872-9b00-d13247f108af None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:37.005482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b6c6d-d5f4-4642-b5b1-9d93853971a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:37.006250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b6c6d-d5f4-4642-b5b1-9d93853971a3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:37.006528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b6c6d-d5f4-4642-b5b1-9d93853971a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:37.006797 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b6c6d-d5f4-4642-b5b1-9d93853971a3 None admin] PATH_INFO: `/v3/projects/0a570b43b29a48ed93337d06e7d2c924` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:37.007999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b6c6d-d5f4-4642-b5b1-9d93853971a3 None admin] RBAC: Authorizing `identity:get_project(project_id=0a570b43b29a48ed93337d06e7d2c924)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:37.009550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b6c6d-d5f4-4642-b5b1-9d93853971a3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:37.011232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 226/449] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:36 2022] GET /identity/v3/projects/0a570b43b29a48ed93337d06e7d2c924 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:37.016433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b6c6d-d5f4-4642-b5b1-9d93853971a3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:37.064464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:37.074639 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e75af-5734-4872-9b00-d13247f108af None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:37.100475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:37.108128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a34198-3088-46f2-b2ca-9795528c0a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:37.108790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a34198-3088-46f2-b2ca-9795528c0a60 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:37.109075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a34198-3088-46f2-b2ca-9795528c0a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:37.109349 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a34198-3088-46f2-b2ca-9795528c0a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:37.112435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b6c6d-d5f4-4642-b5b1-9d93853971a3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:37.145865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e16aeb-6029-465e-a44e-ef5aa7d378f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:37.146702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e16aeb-6029-465e-a44e-ef5aa7d378f4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:37.146982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e16aeb-6029-465e-a44e-ef5aa7d378f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:37.147253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e16aeb-6029-465e-a44e-ef5aa7d378f4 None admin] PATH_INFO: `/v3/groups/ca15336ce76d4f659bfb1ef5269991b8` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:37.148475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e16aeb-6029-465e-a44e-ef5aa7d378f4 None admin] RBAC: Authorizing `identity:get_group(group_id=ca15336ce76d4f659bfb1ef5269991b8)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:37.149895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e16aeb-6029-465e-a44e-ef5aa7d378f4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:37.151908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 227/450] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:37 2022] GET /identity/v3/groups/ca15336ce76d4f659bfb1ef5269991b8 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:37.157337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e16aeb-6029-465e-a44e-ef5aa7d378f4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:37.176053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a34198-3088-46f2-b2ca-9795528c0a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:37.177537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a34198-3088-46f2-b2ca-9795528c0a60 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:37.260700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e16aeb-6029-465e-a44e-ef5aa7d378f4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:37.270131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:37.281013 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 224/451] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 05:54:37.286583 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a34198-3088-46f2-b2ca-9795528c0a60 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:37.294697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fc3f1-0f08-4273-8a70-29e67a87ff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:37.295353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fc3f1-0f08-4273-8a70-29e67a87ff40 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:37.295642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fc3f1-0f08-4273-8a70-29e67a87ff40 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:37.296274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fc3f1-0f08-4273-8a70-29e67a87ff40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:37.297146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fc3f1-0f08-4273-8a70-29e67a87ff40 None admin] RBAC: Adding query filter params (group.id=ca15336ce76d4f659bfb1ef5269991b8, role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=0a570b43b29a48ed93337d06e7d2c924) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:37.297780 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fc3f1-0f08-4273-8a70-29e67a87ff40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:37.299222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fc3f1-0f08-4273-8a70-29e67a87ff40 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:37.305632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 228/452] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 20 05:54:37 2022] GET /identity/v3/role_assignments?group.id=ca15336ce76d4f659bfb1ef5269991b8&scope.project.id=0a570b43b29a48ed93337d06e7d2c924&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:37.388552 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a34198-3088-46f2-b2ca-9795528c0a60 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:37.423405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52674195-3ee5-4fd6-87cd-ed9a2ed24c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:37.424263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674195-3ee5-4fd6-87cd-ed9a2ed24c5c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:37.424570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674195-3ee5-4fd6-87cd-ed9a2ed24c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:37.424843 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674195-3ee5-4fd6-87cd-ed9a2ed24c5c None admin] PATH_INFO: `/v3/projects/7761a3e3dfee4860bce7efebb2025a4b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:37.426058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52674195-3ee5-4fd6-87cd-ed9a2ed24c5c None admin] RBAC: Authorizing `identity:get_project(project_id=7761a3e3dfee4860bce7efebb2025a4b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:37.427527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52674195-3ee5-4fd6-87cd-ed9a2ed24c5c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:37.429355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 225/453] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:54:37 2022] GET /identity/v3/projects/7761a3e3dfee4860bce7efebb2025a4b => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:37.434921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fc3f1-0f08-4273-8a70-29e67a87ff40 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:37.460228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:37.541582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fc3f1-0f08-4273-8a70-29e67a87ff40 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:37.573707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88da72-35e5-42a1-b878-9a29a6acd3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:37.574548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88da72-35e5-42a1-b878-9a29a6acd3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:37.574831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88da72-35e5-42a1-b878-9a29a6acd3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:37.575104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88da72-35e5-42a1-b878-9a29a6acd3c3 None admin] PATH_INFO: `/v3/groups/a124381d3f514d8aa9d4294cf849a74c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:37.576259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88da72-35e5-42a1-b878-9a29a6acd3c3 None admin] RBAC: Authorizing `identity:get_group(group_id=a124381d3f514d8aa9d4294cf849a74c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:37.577725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88da72-35e5-42a1-b878-9a29a6acd3c3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:37.579327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 229/454] 10.222.0.13 () {56 vars in 1180 bytes} [Mon Jun 20 05:54:37 2022] GET /identity/v3/groups/a124381d3f514d8aa9d4294cf849a74c => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:37.585185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52674195-3ee5-4fd6-87cd-ed9a2ed24c5c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:37.641087 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:37.681095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52674195-3ee5-4fd6-87cd-ed9a2ed24c5c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:37.713595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4a4e4-e7fe-4d9e-a85c-9fa1704c65f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:37.714232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a4e4-e7fe-4d9e-a85c-9fa1704c65f7 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:37.714517 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a4e4-e7fe-4d9e-a85c-9fa1704c65f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:37.714794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4a4e4-e7fe-4d9e-a85c-9fa1704c65f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:37.715620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4a4e4-e7fe-4d9e-a85c-9fa1704c65f7 None admin] RBAC: Adding query filter params (group.id=a124381d3f514d8aa9d4294cf849a74c, role.id=5cdb558ab7044154896c8f9e3dfba431, scope.project.id=7761a3e3dfee4860bce7efebb2025a4b) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:37.715935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4a4e4-e7fe-4d9e-a85c-9fa1704c65f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:37.717419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4a4e4-e7fe-4d9e-a85c-9fa1704c65f7 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:37.722999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 226/455] 10.222.0.13 () {56 vars in 1376 bytes} [Mon Jun 20 05:54:37 2022] GET /identity/v3/role_assignments?group.id=a124381d3f514d8aa9d4294cf849a74c&scope.project.id=7761a3e3dfee4860bce7efebb2025a4b&role.id=5cdb558ab7044154896c8f9e3dfba431 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:40.351591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da15d0-74e1-4b95-b356-595d76acce87 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:40.352609 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da15d0-74e1-4b95-b356-595d76acce87 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:40.353095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da15d0-74e1-4b95-b356-595d76acce87 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:40.355008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 230/456] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:40.360006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcbd71-1e14-42c4-9b87-ccb153a8f32a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:40.360922 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcbd71-1e14-42c4-9b87-ccb153a8f32a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:40.361407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcbd71-1e14-42c4-9b87-ccb153a8f32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:40.388521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-e5dcbd71-1e14-42c4-9b87-ccb153a8f32a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:40.390054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e5dcbd71-1e14-42c4-9b87-ccb153a8f32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:40.489886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 227/457] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:40.527324 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da15d0-74e1-4b95-b356-595d76acce87 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:40.531396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179dcce-2e8f-441e-8898-a0de543fee4b None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:40.532863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179dcce-2e8f-441e-8898-a0de543fee4b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:40.533373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179dcce-2e8f-441e-8898-a0de543fee4b None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:40.535220 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 228/458] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:40.540832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f90a0-c082-44cd-8901-3488a1de80fe None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:40.541350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f90a0-c082-44cd-8901-3488a1de80fe None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:40.541833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f90a0-c082-44cd-8901-3488a1de80fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:40.572697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-7c1f90a0-c082-44cd-8901-3488a1de80fe None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:40.574273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7c1f90a0-c082-44cd-8901-3488a1de80fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:40.631691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:40.646950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da15d0-74e1-4b95-b356-595d76acce87 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:40.672722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:40.685846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fef88-53b6-4a37-9f80-1089db76a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:40.687264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fef88-53b6-4a37-9f80-1089db76a171 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:40.687716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fef88-53b6-4a37-9f80-1089db76a171 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:40.688416 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fef88-53b6-4a37-9f80-1089db76a171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:40.698057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 229/459] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:40.698057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1eea-9cfe-48ba-9b6e-25ffc23e8a6e None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:40.698057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1eea-9cfe-48ba-9b6e-25ffc23e8a6e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:40.698057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae1eea-9cfe-48ba-9b6e-25ffc23e8a6e None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:40.698057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 230/460] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:40.704352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1740a2-c683-402e-9953-22bd0962f0e3 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:40.704352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1740a2-c683-402e-9953-22bd0962f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:40.704352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1740a2-c683-402e-9953-22bd0962f0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:40.710541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fef88-53b6-4a37-9f80-1089db76a171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:40.712192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55fef88-53b6-4a37-9f80-1089db76a171 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:40.721205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8f1740a2-c683-402e-9953-22bd0962f0e3 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:40.722711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8f1740a2-c683-402e-9953-22bd0962f0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-b55fef88-53b6-4a37-9f80-1089db76a171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:40.746232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:40.747294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:40.748351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:40.748351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:40.748351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:40.748351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:40.749206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 231/461] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:40.751268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fef88-53b6-4a37-9f80-1089db76a171 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:40.813489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 231/462] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:40.814447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1740a2-c683-402e-9953-22bd0962f0e3 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:40.871842 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55fef88-53b6-4a37-9f80-1089db76a171 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:40.911376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7658b6-d6c1-442a-ae02-5521dabc2bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:40.912502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7658b6-d6c1-442a-ae02-5521dabc2bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:40.912956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7658b6-d6c1-442a-ae02-5521dabc2bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:40.913380 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7658b6-d6c1-442a-ae02-5521dabc2bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:40.917614 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1740a2-c683-402e-9953-22bd0962f0e3 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:40.923028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:40.925446 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7658b6-d6c1-442a-ae02-5521dabc2bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:40.926974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7658b6-d6c1-442a-ae02-5521dabc2bc8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:40.933716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-7a7658b6-d6c1-442a-ae02-5521dabc2bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:40.947161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:40.948007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:40.948916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:40.948916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:40.948916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:40.948916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:40.948916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 232/463] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:40.953662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7658b6-d6c1-442a-ae02-5521dabc2bc8 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:40.958136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5badf-b7c1-4652-b399-328721b211b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:40.958798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5badf-b7c1-4652-b399-328721b211b9 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:40.959084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5badf-b7c1-4652-b399-328721b211b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:40.959359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5badf-b7c1-4652-b399-328721b211b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:40.960091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5badf-b7c1-4652-b399-328721b211b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:40.960964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5badf-b7c1-4652-b399-328721b211b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:40.962377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5badf-b7c1-4652-b399-328721b211b9 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:40.973881 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 232/464] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:40.976671 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ffc73-bd31-474a-8dec-6d4656e03b9c None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:40.977203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ffc73-bd31-474a-8dec-6d4656e03b9c None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:40.978025 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ffc73-bd31-474a-8dec-6d4656e03b9c None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:40.979530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 233/465] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:40.980469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ffc73-bd31-474a-8dec-6d4656e03b9c None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:41.066168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7658b6-d6c1-442a-ae02-5521dabc2bc8 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:41.087595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ffc73-bd31-474a-8dec-6d4656e03b9c None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:41.100664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c397-944c-410c-92f0-93a4b7f0b0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:41.101510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c397-944c-410c-92f0-93a4b7f0b0cb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:41.101795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c397-944c-410c-92f0-93a4b7f0b0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:41.102074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1c397-944c-410c-92f0-93a4b7f0b0cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:41.111892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1c397-944c-410c-92f0-93a4b7f0b0cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:41.113404 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1c397-944c-410c-92f0-93a4b7f0b0cb None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:41.124489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308f58b-b8a3-4460-b7b1-cae59b4a1834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:41.125305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f58b-b8a3-4460-b7b1-cae59b4a1834 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:41.125732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f58b-b8a3-4460-b7b1-cae59b4a1834 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:41.126175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f58b-b8a3-4460-b7b1-cae59b4a1834 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:41.127035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308f58b-b8a3-4460-b7b1-cae59b4a1834 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:41.127487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308f58b-b8a3-4460-b7b1-cae59b4a1834 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:41.129003 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308f58b-b8a3-4460-b7b1-cae59b4a1834 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e6b1c397-944c-410c-92f0-93a4b7f0b0cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:41.131378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:41.132369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:41.133354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:41.133354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:41.133354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:41.133354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:41.133354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 233/466] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:41.133354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c397-944c-410c-92f0-93a4b7f0b0cb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:41.143425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 234/467] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:41.144956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a8df-00a8-42c9-afeb-8e5a359db9a6 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:41.145449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a8df-00a8-42c9-afeb-8e5a359db9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:41.145735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a8df-00a8-42c9-afeb-8e5a359db9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:41.162669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-6683a8df-00a8-42c9-afeb-8e5a359db9a6 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:41.164416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6683a8df-00a8-42c9-afeb-8e5a359db9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:41.188415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:41.189475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:41.236389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 235/468] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:41.236389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683a8df-00a8-42c9-afeb-8e5a359db9a6 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:41.264991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1c397-944c-410c-92f0-93a4b7f0b0cb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:41.301611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fe8b6-9531-44a2-9d12-bce4a1189f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:41.302280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fe8b6-9531-44a2-9d12-bce4a1189f3c None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:41.302562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fe8b6-9531-44a2-9d12-bce4a1189f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:41.302832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fe8b6-9531-44a2-9d12-bce4a1189f3c None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:41.303587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fe8b6-9531-44a2-9d12-bce4a1189f3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:41.305103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fe8b6-9531-44a2-9d12-bce4a1189f3c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:41.327304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 234/469] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:54:41 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:54:41.328023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fe8b6-9531-44a2-9d12-bce4a1189f3c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:41.362253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683a8df-00a8-42c9-afeb-8e5a359db9a6 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:41.403864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925fcb8-cb8c-473a-9fa6-924e054f3c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:41.404585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925fcb8-cb8c-473a-9fa6-924e054f3c2a None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:41.404876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925fcb8-cb8c-473a-9fa6-924e054f3c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:41.405156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925fcb8-cb8c-473a-9fa6-924e054f3c2a None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:41.405904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925fcb8-cb8c-473a-9fa6-924e054f3c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:41.406217 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925fcb8-cb8c-473a-9fa6-924e054f3c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:41.407655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925fcb8-cb8c-473a-9fa6-924e054f3c2a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:41.425112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 236/470] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:41.425112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925fcb8-cb8c-473a-9fa6-924e054f3c2a None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:41.451941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:41.482838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:41.487884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fe8b6-9531-44a2-9d12-bce4a1189f3c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:41.540297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a3767-842a-4b3d-9fce-72494fc41a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:41.541265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a3767-842a-4b3d-9fce-72494fc41a21 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:41.541384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a3767-842a-4b3d-9fce-72494fc41a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:41.541568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a3767-842a-4b3d-9fce-72494fc41a21 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:41.542280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a3767-842a-4b3d-9fce-72494fc41a21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:41.543730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a3767-842a-4b3d-9fce-72494fc41a21 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:41.545241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925fcb8-cb8c-473a-9fa6-924e054f3c2a None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:41.570640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 235/471] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:54:41 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:54:41.571227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a3767-842a-4b3d-9fce-72494fc41a21 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:41.589563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4fa37-6353-405b-914c-60bceced1cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:41.590502 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4fa37-6353-405b-914c-60bceced1cff None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:41.591245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4fa37-6353-405b-914c-60bceced1cff None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:41.591538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4fa37-6353-405b-914c-60bceced1cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:41.608805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4fa37-6353-405b-914c-60bceced1cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:41.611985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4fa37-6353-405b-914c-60bceced1cff None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-07b4fa37-6353-405b-914c-60bceced1cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:41.635942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:41.637026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:41.637867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:41.637867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:41.637867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:41.637867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:41.638625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 237/472] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:41.645527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4fa37-6353-405b-914c-60bceced1cff None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:41.704456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a3767-842a-4b3d-9fce-72494fc41a21 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:41.768695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:41.793979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4fa37-6353-405b-914c-60bceced1cff None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:41.802053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25ba0d-08fd-4e47-8618-97ced4803666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:41.802769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25ba0d-08fd-4e47-8618-97ced4803666 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:41.803054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25ba0d-08fd-4e47-8618-97ced4803666 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:41.803331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25ba0d-08fd-4e47-8618-97ced4803666 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:41.805433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25ba0d-08fd-4e47-8618-97ced4803666 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:41.806048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25ba0d-08fd-4e47-8618-97ced4803666 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:41.839522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 236/473] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:54:41 2022] POST /identity/v3/users => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:54:41.853422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68617ec0-f5be-4437-b1e4-b15104d9daad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:41.854122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68617ec0-f5be-4437-b1e4-b15104d9daad None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:41.854526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68617ec0-f5be-4437-b1e4-b15104d9daad None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:41.854815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68617ec0-f5be-4437-b1e4-b15104d9daad None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:41.855672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68617ec0-f5be-4437-b1e4-b15104d9daad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:41.856027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68617ec0-f5be-4437-b1e4-b15104d9daad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:41.857522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68617ec0-f5be-4437-b1e4-b15104d9daad None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:41.868946 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038e75-7eba-4f29-93c8-5755d0551d0f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:41.869267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038e75-7eba-4f29-93c8-5755d0551d0f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:41.869504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038e75-7eba-4f29-93c8-5755d0551d0f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:41.872711 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 237/474] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:41.875516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 238/475] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:41.880351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c42e-ee6a-4172-b3c3-00e3dcea6bcc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:41.880657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c42e-ee6a-4172-b3c3-00e3dcea6bcc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:41.880944 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c42e-ee6a-4172-b3c3-00e3dcea6bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:41.881408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68617ec0-f5be-4437-b1e4-b15104d9daad None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:41.902443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fea1c42e-ee6a-4172-b3c3-00e3dcea6bcc None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:41.903893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fea1c42e-ee6a-4172-b3c3-00e3dcea6bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:41.915726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:42.009025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 238/476] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:42.033862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c42e-ee6a-4172-b3c3-00e3dcea6bcc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:42.034207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68617ec0-f5be-4437-b1e4-b15104d9daad None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:42.080938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2397a-f797-4a2e-b95c-bce305275a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:42.081613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2397a-f797-4a2e-b95c-bce305275a3f None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:42.081899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2397a-f797-4a2e-b95c-bce305275a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:42.082175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2397a-f797-4a2e-b95c-bce305275a3f None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:42.082904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2397a-f797-4a2e-b95c-bce305275a3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:42.084365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2397a-f797-4a2e-b95c-bce305275a3f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:42.095704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:42.110435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 239/477] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:54:41 2022] POST /identity/v3/users => generated 249 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:54:42.155964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c42e-ee6a-4172-b3c3-00e3dcea6bcc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:42.198509 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24e41d-302e-4af6-bb37-0234d5f82adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:42.199254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24e41d-302e-4af6-bb37-0234d5f82adb None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:42.199543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24e41d-302e-4af6-bb37-0234d5f82adb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:42.199824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24e41d-302e-4af6-bb37-0234d5f82adb None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:42.200750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24e41d-302e-4af6-bb37-0234d5f82adb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:42.202054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24e41d-302e-4af6-bb37-0234d5f82adb None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:42.210074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.sql.core [None req-da24e41d-302e-4af6-bb37-0234d5f82adb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 05:54:42.210074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 05:54:42.210074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [parameters: {'id': '2c89e9a3435645b180f1eac865b98bff', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 05:54:42.210074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80116) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-da24e41d-302e-4af6-bb37-0234d5f82adb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Jun 20 05:54:42.228869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return ref.to_dict() Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:54:42.229869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application yield resource Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise self.value Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application session.commit() Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 05:54:42.231040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.flush() Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application compat.raise_( Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 05:54:42.232120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:54:42.233037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:54:42.233847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [parameters: {'id': '2c89e9a3435645b180f1eac865b98bff', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:42.235796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 05:54:42.237807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:42.239846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 239/478] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Jun 20 05:54:42 2022] POST /identity/v3/roles => generated 144 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:42.251938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2397a-f797-4a2e-b95c-bce305275a3f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:42.397985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2397a-f797-4a2e-b95c-bce305275a3f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:42.437324 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f64aa3-8c49-4e8e-9de8-694cb2c02c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:42.438137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f64aa3-8c49-4e8e-9de8-694cb2c02c24 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:42.438424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f64aa3-8c49-4e8e-9de8-694cb2c02c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:42.438699 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f64aa3-8c49-4e8e-9de8-694cb2c02c24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:42.450680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f64aa3-8c49-4e8e-9de8-694cb2c02c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-55f64aa3-8c49-4e8e-9de8-694cb2c02c24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:42.459090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:42.459970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:42.461259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 240/479] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:54:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:42.466234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24e41d-302e-4af6-bb37-0234d5f82adb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:42.476532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:42.587440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24e41d-302e-4af6-bb37-0234d5f82adb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:42.634568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899dacb1-70eb-4bac-bd43-aaa3e4c3b638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:42.635600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dacb1-70eb-4bac-bd43-aaa3e4c3b638 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:42.636103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dacb1-70eb-4bac-bd43-aaa3e4c3b638 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:42.636594 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dacb1-70eb-4bac-bd43-aaa3e4c3b638 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:42.638265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dacb1-70eb-4bac-bd43-aaa3e4c3b638 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:42.639093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dacb1-70eb-4bac-bd43-aaa3e4c3b638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:42.640709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899dacb1-70eb-4bac-bd43-aaa3e4c3b638 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:42.655134 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 240/480] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:43.797215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef52ddb-a406-46d0-8e00-5df35c12c974 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:43.797762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef52ddb-a406-46d0-8e00-5df35c12c974 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:43.797762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef52ddb-a406-46d0-8e00-5df35c12c974 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:43.799418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 241/481] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:43.804960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c7ad-64ab-439d-98d6-a773a3c72624 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:43.805767 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c7ad-64ab-439d-98d6-a773a3c72624 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:43.806264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c7ad-64ab-439d-98d6-a773a3c72624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:43.829390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b930c7ad-64ab-439d-98d6-a773a3c72624 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:43.831020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b930c7ad-64ab-439d-98d6-a773a3c72624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:43.893142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:43.899484 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 241/482] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:43.939486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef52ddb-a406-46d0-8e00-5df35c12c974 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:43.997437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:44.070054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef52ddb-a406-46d0-8e00-5df35c12c974 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:44.104234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f90849-1481-449d-bcae-5d926b8626de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:44.105436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f90849-1481-449d-bcae-5d926b8626de None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.105942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f90849-1481-449d-bcae-5d926b8626de None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.106431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f90849-1481-449d-bcae-5d926b8626de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.125166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f90849-1481-449d-bcae-5d926b8626de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-84f90849-1481-449d-bcae-5d926b8626de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:44.133740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:44.134629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:44.135409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:44.137774 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 242/483] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:44.143634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930c7ad-64ab-439d-98d6-a773a3c72624 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:44.258879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930c7ad-64ab-439d-98d6-a773a3c72624 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:44.305149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0799fe-acbe-4e02-aa03-80a2f89d125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:44.306207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0799fe-acbe-4e02-aa03-80a2f89d125c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.306702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0799fe-acbe-4e02-aa03-80a2f89d125c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.307176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0799fe-acbe-4e02-aa03-80a2f89d125c None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.308128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0799fe-acbe-4e02-aa03-80a2f89d125c None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:44.308664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0799fe-acbe-4e02-aa03-80a2f89d125c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:44.310254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0799fe-acbe-4e02-aa03-80a2f89d125c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:44.324190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 242/484] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:44.329588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f90849-1481-449d-bcae-5d926b8626de None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:44.395471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74684a30-fb17-461d-8240-c7a58eafc7e3 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.395761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74684a30-fb17-461d-8240-c7a58eafc7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.396047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74684a30-fb17-461d-8240-c7a58eafc7e3 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.398306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 243/485] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:44.404340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb4d6f-3ab4-4327-b92d-d0e124e51b86 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.404637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb4d6f-3ab4-4327-b92d-d0e124e51b86 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.404919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb4d6f-3ab4-4327-b92d-d0e124e51b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.431705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7dbb4d6f-3ab4-4327-b92d-d0e124e51b86 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:44.432914 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7dbb4d6f-3ab4-4327-b92d-d0e124e51b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:44.507790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f90849-1481-449d-bcae-5d926b8626de None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:44.518487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:44.535668 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:44.555774 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 244/486] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:44.569949 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad66ff5-c5f6-47da-a6d2-71528689493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:44.570762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66ff5-c5f6-47da-a6d2-71528689493f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.571051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66ff5-c5f6-47da-a6d2-71528689493f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.571333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad66ff5-c5f6-47da-a6d2-71528689493f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.582690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad66ff5-c5f6-47da-a6d2-71528689493f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:44.584100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad66ff5-c5f6-47da-a6d2-71528689493f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-0ad66ff5-c5f6-47da-a6d2-71528689493f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:44.602316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:44.603197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:44.604653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:44.604653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:44.604653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:44.604653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:44.604653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 243/487] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:44.609250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb4d6f-3ab4-4327-b92d-d0e124e51b86 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:44.615912 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad66ff5-c5f6-47da-a6d2-71528689493f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:44.737439 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad66ff5-c5f6-47da-a6d2-71528689493f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:44.768243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb4d6f-3ab4-4327-b92d-d0e124e51b86 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:44.772466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1cfc9-0082-47fe-bdab-b8cc86ca5b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:44.773820 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1cfc9-0082-47fe-bdab-b8cc86ca5b31 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.774109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1cfc9-0082-47fe-bdab-b8cc86ca5b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.774390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1cfc9-0082-47fe-bdab-b8cc86ca5b31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.785816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1cfc9-0082-47fe-bdab-b8cc86ca5b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-4fc1cfc9-0082-47fe-bdab-b8cc86ca5b31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:44.794269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:44.795361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:44.796505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:44.797133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 244/488] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:44.798204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b354736-ff34-41fc-8aa8-a7b09ef2c5a0 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.798729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b354736-ff34-41fc-8aa8-a7b09ef2c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.798811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b354736-ff34-41fc-8aa8-a7b09ef2c5a0 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.800220 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 245/489] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:44.801572 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe4f0a-bcd9-4756-9b1f-6eeb9054c6d9 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.801702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe4f0a-bcd9-4756-9b1f-6eeb9054c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.801942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe4f0a-bcd9-4756-9b1f-6eeb9054c6d9 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.803260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 246/490] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:44.807866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe4f0a-bcd9-4756-9b1f-6eeb9054c6d9 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:44.811830 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16358372-e183-4b3d-96ff-bde262488df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:44.813128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358372-e183-4b3d-96ff-bde262488df9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.813332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358372-e183-4b3d-96ff-bde262488df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.813609 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358372-e183-4b3d-96ff-bde262488df9 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.814347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358372-e183-4b3d-96ff-bde262488df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:44.814661 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358372-e183-4b3d-96ff-bde262488df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:44.816046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358372-e183-4b3d-96ff-bde262488df9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:44.833668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:44.834714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 245/491] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:44.841826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e9528-cb3b-4c77-b9df-372ad3ea8f62 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.842080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e9528-cb3b-4c77-b9df-372ad3ea8f62 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.842842 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e9528-cb3b-4c77-b9df-372ad3ea8f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.860648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-167e9528-cb3b-4c77-b9df-372ad3ea8f62 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:44.862226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-167e9528-cb3b-4c77-b9df-372ad3ea8f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:44.911656 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe4f0a-bcd9-4756-9b1f-6eeb9054c6d9 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:44.918907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:44.952109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 246/492] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:44.952109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69d23-0147-46c8-a653-65fec70885ed None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.952109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69d23-0147-46c8-a653-65fec70885ed None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.952109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69d23-0147-46c8-a653-65fec70885ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.956498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d464d5d-09e1-44ca-891a-c5763d270643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:44.957177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d464d5d-09e1-44ca-891a-c5763d270643 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:44.957581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d464d5d-09e1-44ca-891a-c5763d270643 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:44.957791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d464d5d-09e1-44ca-891a-c5763d270643 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:44.958617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d464d5d-09e1-44ca-891a-c5763d270643 None admin] RBAC: Adding query filter params (name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:44.958934 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d464d5d-09e1-44ca-891a-c5763d270643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:44.960562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d464d5d-09e1-44ca-891a-c5763d270643 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:44.969045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-54d69d23-0147-46c8-a653-65fec70885ed None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:44.970238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-54d69d23-0147-46c8-a653-65fec70885ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:44.971580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 247/493] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:44.972596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d464d5d-09e1-44ca-891a-c5763d270643 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:45.040813 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 247/494] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:45.041668 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d69d23-0147-46c8-a653-65fec70885ed None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:45.067893 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:45.082062 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d464d5d-09e1-44ca-891a-c5763d270643 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:45.117300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb8cc3-ab6d-4a55-aebb-a60119890647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:45.118097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb8cc3-ab6d-4a55-aebb-a60119890647 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:45.118378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb8cc3-ab6d-4a55-aebb-a60119890647 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:45.118649 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb8cc3-ab6d-4a55-aebb-a60119890647 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:45.126648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb8cc3-ab6d-4a55-aebb-a60119890647 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:45.128092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb8cc3-ab6d-4a55-aebb-a60119890647 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-e2bb8cc3-ab6d-4a55-aebb-a60119890647 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:45.143860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:45.144975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 248/495] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:45.145898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb8cc3-ab6d-4a55-aebb-a60119890647 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:45.159270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d69d23-0147-46c8-a653-65fec70885ed None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:45.171514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:45.198068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd376-9732-4780-b11a-dc5957dd7471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:45.198969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd376-9732-4780-b11a-dc5957dd7471 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:45.199262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd376-9732-4780-b11a-dc5957dd7471 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:45.199542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cd376-9732-4780-b11a-dc5957dd7471 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:45.209984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cd376-9732-4780-b11a-dc5957dd7471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-db8cd376-9732-4780-b11a-dc5957dd7471 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:45.218268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:45.219334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:45.220121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 248/496] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:45.220886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd376-9732-4780-b11a-dc5957dd7471 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:45.266235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb8cc3-ab6d-4a55-aebb-a60119890647 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:45.304775 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808c314-4735-4d4e-8295-719b0fb8aafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:45.306069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808c314-4735-4d4e-8295-719b0fb8aafd None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:45.306526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808c314-4735-4d4e-8295-719b0fb8aafd None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:45.307026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808c314-4735-4d4e-8295-719b0fb8aafd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:45.323266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808c314-4735-4d4e-8295-719b0fb8aafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:45.323266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0808c314-4735-4d4e-8295-719b0fb8aafd None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:45.326490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-0808c314-4735-4d4e-8295-719b0fb8aafd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:45.344960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:45.345907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:45.346821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:45.346821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:45.346821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:45.346821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:45.346821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 249/497] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:45.347088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808c314-4735-4d4e-8295-719b0fb8aafd None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:45.358978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cd376-9732-4780-b11a-dc5957dd7471 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:45.397463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1255be0-56c9-4576-be81-3237fe8891f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:45.398134 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1255be0-56c9-4576-be81-3237fe8891f2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:45.398418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1255be0-56c9-4576-be81-3237fe8891f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:45.398694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1255be0-56c9-4576-be81-3237fe8891f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:45.410761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1255be0-56c9-4576-be81-3237fe8891f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f1255be0-56c9-4576-be81-3237fe8891f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:45.418498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:45.419667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 249/498] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:45.421349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1255be0-56c9-4576-be81-3237fe8891f2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:45.452185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:45.470289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808c314-4735-4d4e-8295-719b0fb8aafd None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:45.503591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d964-5f61-46b1-8fdb-eee2e6608f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:45.504254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d964-5f61-46b1-8fdb-eee2e6608f6f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:45.504571 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d964-5f61-46b1-8fdb-eee2e6608f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:45.504858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6d964-5f61-46b1-8fdb-eee2e6608f6f None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:45.505709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6d964-5f61-46b1-8fdb-eee2e6608f6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:45.506025 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6d964-5f61-46b1-8fdb-eee2e6608f6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:45.508048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6d964-5f61-46b1-8fdb-eee2e6608f6f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:45.522304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1255be0-56c9-4576-be81-3237fe8891f2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:45.544473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 250/499] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 20 05:54:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:45.545301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d964-5f61-46b1-8fdb-eee2e6608f6f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:45.561328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dcf59-7c82-4af6-b07f-03390d5a3007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:45.561753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dcf59-7c82-4af6-b07f-03390d5a3007 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:45.562049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dcf59-7c82-4af6-b07f-03390d5a3007 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:45.562324 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25dcf59-7c82-4af6-b07f-03390d5a3007 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:45.563082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dcf59-7c82-4af6-b07f-03390d5a3007 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:45.563391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dcf59-7c82-4af6-b07f-03390d5a3007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:45.564825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25dcf59-7c82-4af6-b07f-03390d5a3007 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:45.574207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 250/500] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:45.574987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dcf59-7c82-4af6-b07f-03390d5a3007 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:45.602127 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:45.647721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6d964-5f61-46b1-8fdb-eee2e6608f6f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:45.665589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:45.675262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25dcf59-7c82-4af6-b07f-03390d5a3007 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:45.681694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116d823-1ff5-42d2-9074-307fcda0e639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:45.682360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116d823-1ff5-42d2-9074-307fcda0e639 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:45.682649 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116d823-1ff5-42d2-9074-307fcda0e639 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:45.682931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116d823-1ff5-42d2-9074-307fcda0e639 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:45.683663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116d823-1ff5-42d2-9074-307fcda0e639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:45.683976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116d823-1ff5-42d2-9074-307fcda0e639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:45.685403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116d823-1ff5-42d2-9074-307fcda0e639 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:45.696547 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 251/501] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:45.697851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0eb7f-70e9-4322-b2bc-14a05226f05b None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:45.698134 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0eb7f-70e9-4322-b2bc-14a05226f05b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:45.698412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0eb7f-70e9-4322-b2bc-14a05226f05b None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:45.699677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 252/502] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:45.700403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0eb7f-70e9-4322-b2bc-14a05226f05b None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:45.716902 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c752a5-1e62-478e-bebd-2fa2ae08c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:45.717569 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c752a5-1e62-478e-bebd-2fa2ae08c170 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:45.717852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c752a5-1e62-478e-bebd-2fa2ae08c170 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:45.718128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c752a5-1e62-478e-bebd-2fa2ae08c170 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:45.718875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c752a5-1e62-478e-bebd-2fa2ae08c170 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:45.719184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c752a5-1e62-478e-bebd-2fa2ae08c170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:45.720584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c752a5-1e62-478e-bebd-2fa2ae08c170 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:45.728985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 251/503] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:45.729753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c752a5-1e62-478e-bebd-2fa2ae08c170 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:45.805772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0eb7f-70e9-4322-b2bc-14a05226f05b None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:45.819587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:45.830368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c752a5-1e62-478e-bebd-2fa2ae08c170 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:45.839310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c642c7-a37d-40de-b675-40833f75557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:45.839951 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c642c7-a37d-40de-b675-40833f75557d None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:45.840243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c642c7-a37d-40de-b675-40833f75557d None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:45.840546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c642c7-a37d-40de-b675-40833f75557d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:45.862760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024214-826c-4dbd-b9e4-843cc9057bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:45.863554 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024214-826c-4dbd-b9e4-843cc9057bea None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:45.863834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024214-826c-4dbd-b9e4-843cc9057bea None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:45.864111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd024214-826c-4dbd-b9e4-843cc9057bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:45.874360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd024214-826c-4dbd-b9e4-843cc9057bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:45.875805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd024214-826c-4dbd-b9e4-843cc9057bea None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-cd024214-826c-4dbd-b9e4-843cc9057bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:45.892746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:45.893587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:45.894425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:45.894425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:45.894425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:45.894425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:45.894425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 252/504] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:45.894687 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024214-826c-4dbd-b9e4-843cc9057bea None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:45.905611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:45.911557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c642c7-a37d-40de-b675-40833f75557d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:45.913063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c642c7-a37d-40de-b675-40833f75557d None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:45.995724 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd024214-826c-4dbd-b9e4-843cc9057bea None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:46.013254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 253/505] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:46.014752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdd635-116f-409e-bfa8-0a3229c20798 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:46.015043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdd635-116f-409e-bfa8-0a3229c20798 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:46.015324 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbdd635-116f-409e-bfa8-0a3229c20798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:46.031757 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-0dbdd635-116f-409e-bfa8-0a3229c20798 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:46.032970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0dbdd635-116f-409e-bfa8-0a3229c20798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:46.034567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae10ba7-925d-4e66-8d68-d8e0dd85f150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:46.035359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae10ba7-925d-4e66-8d68-d8e0dd85f150 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:46.035642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae10ba7-925d-4e66-8d68-d8e0dd85f150 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:46.035915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae10ba7-925d-4e66-8d68-d8e0dd85f150 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:46.042564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:46.043504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae10ba7-925d-4e66-8d68-d8e0dd85f150 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:46.045322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae10ba7-925d-4e66-8d68-d8e0dd85f150 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-1ae10ba7-925d-4e66-8d68-d8e0dd85f150 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:46.061748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:46.062718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:46.063587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:46.063587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:46.063587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:46.063587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:46.063587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:46.063587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:46.063587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:46.063587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:46.063587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:54:46.063587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:46.063587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 253/506] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:46.068290 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae10ba7-925d-4e66-8d68-d8e0dd85f150 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:46.098922 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 254/507] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:46.099747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdd635-116f-409e-bfa8-0a3229c20798 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:46.139654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:46.175326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae10ba7-925d-4e66-8d68-d8e0dd85f150 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:46.194360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbdd635-116f-409e-bfa8-0a3229c20798 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:46.208649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06cc8-8fe3-4344-85a0-b50c1fbf8749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:46.209435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06cc8-8fe3-4344-85a0-b50c1fbf8749 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:46.209715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06cc8-8fe3-4344-85a0-b50c1fbf8749 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:46.209989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06cc8-8fe3-4344-85a0-b50c1fbf8749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:46.220619 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06cc8-8fe3-4344-85a0-b50c1fbf8749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:46.222245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06cc8-8fe3-4344-85a0-b50c1fbf8749 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:46.227345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa76fc-0788-49c5-a76b-344230879a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:46.227993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa76fc-0788-49c5-a76b-344230879a15 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:46.228274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa76fc-0788-49c5-a76b-344230879a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:46.228575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa76fc-0788-49c5-a76b-344230879a15 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:46.229292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa76fc-0788-49c5-a76b-344230879a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:46.229597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa76fc-0788-49c5-a76b-344230879a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:46.230973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa76fc-0788-49c5-a76b-344230879a15 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-cca06cc8-8fe3-4344-85a0-b50c1fbf8749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:46.242199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:46.243029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:46.243859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:46.243859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:46.243859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:46.243859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:46.243859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 254/508] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:46.244659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06cc8-8fe3-4344-85a0-b50c1fbf8749 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:46.244920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 255/509] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:46.245936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa76fc-0788-49c5-a76b-344230879a15 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:46.249562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:46.344164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa76fc-0788-49c5-a76b-344230879a15 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:46.345169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06cc8-8fe3-4344-85a0-b50c1fbf8749 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:46.361662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:46.383770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d929da-49d6-482f-b97c-6ad02c5c2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:46.383967 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffb2de-0d53-4881-918b-a7307438c191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:46.384591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d929da-49d6-482f-b97c-6ad02c5c2fbb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:46.384698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffb2de-0d53-4881-918b-a7307438c191 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:46.384872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d929da-49d6-482f-b97c-6ad02c5c2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:46.384972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffb2de-0d53-4881-918b-a7307438c191 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:46.385143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d929da-49d6-482f-b97c-6ad02c5c2fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:46.385255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffb2de-0d53-4881-918b-a7307438c191 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:46.385998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffb2de-0d53-4881-918b-a7307438c191 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:46.386315 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffb2de-0d53-4881-918b-a7307438c191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:46.387755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffb2de-0d53-4881-918b-a7307438c191 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:46.396652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d929da-49d6-482f-b97c-6ad02c5c2fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:46.398122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d929da-49d6-482f-b97c-6ad02c5c2fbb None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:46.406594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 256/510] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 20 05:54:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:46.407409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffb2de-0d53-4881-918b-a7307438c191 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-06d929da-49d6-482f-b97c-6ad02c5c2fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:46.417823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:46.418977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:46.420023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:46.420023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:46.420023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:46.420023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:46.420023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 255/511] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:46.420379 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d929da-49d6-482f-b97c-6ad02c5c2fbb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:46.473060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:46.511048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffb2de-0d53-4881-918b-a7307438c191 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:46.520437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d929da-49d6-482f-b97c-6ad02c5c2fbb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:46.545094 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707e56-02e8-417a-8615-b006a26fc23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:46.545891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707e56-02e8-417a-8615-b006a26fc23b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:46.546185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707e56-02e8-417a-8615-b006a26fc23b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:46.546466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f707e56-02e8-417a-8615-b006a26fc23b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:46.553785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502b8c9-6d5d-42f1-84ba-c061b9907d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:46.555188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502b8c9-6d5d-42f1-84ba-c061b9907d58 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:46.555469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502b8c9-6d5d-42f1-84ba-c061b9907d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:46.555741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502b8c9-6d5d-42f1-84ba-c061b9907d58 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:46.556888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f707e56-02e8-417a-8615-b006a26fc23b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:46.558346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f707e56-02e8-417a-8615-b006a26fc23b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:46.563507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502b8c9-6d5d-42f1-84ba-c061b9907d58 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:46.564985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502b8c9-6d5d-42f1-84ba-c061b9907d58 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-9f707e56-02e8-417a-8615-b006a26fc23b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:46.575588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:46.576625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:46.577682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:46.577682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:46.577682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:46.577682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a502b8c9-6d5d-42f1-84ba-c061b9907d58 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:46.579732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:46.580792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:46.582340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:46.582340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:46.582340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:46.582340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:46.582340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:46.582340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:46.582340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:46.582340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:46.582340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:54:46.582340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:46.582973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 257/512] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:46.582973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707e56-02e8-417a-8615-b006a26fc23b None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:46.584447 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 256/513] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:46.585381 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502b8c9-6d5d-42f1-84ba-c061b9907d58 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:46.615425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:46.681320 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f707e56-02e8-417a-8615-b006a26fc23b None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:46.683739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502b8c9-6d5d-42f1-84ba-c061b9907d58 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:46.695018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:46.717463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513605f7-9df4-48cb-bff4-e8e0c4f6e007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:46.718106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513605f7-9df4-48cb-bff4-e8e0c4f6e007 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:46.718388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513605f7-9df4-48cb-bff4-e8e0c4f6e007 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:46.718563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a96b-3fb1-4c7b-8a36-c3afc17291a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:46.718669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513605f7-9df4-48cb-bff4-e8e0c4f6e007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:46.719225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a96b-3fb1-4c7b-8a36-c3afc17291a0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:46.719576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a96b-3fb1-4c7b-8a36-c3afc17291a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:46.719786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a96b-3fb1-4c7b-8a36-c3afc17291a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:46.720546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99a96b-3fb1-4c7b-8a36-c3afc17291a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:46.720858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99a96b-3fb1-4c7b-8a36-c3afc17291a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:46.722231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99a96b-3fb1-4c7b-8a36-c3afc17291a0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:46.734680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 258/514] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:46.735426 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a96b-3fb1-4c7b-8a36-c3afc17291a0 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:46.791605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513605f7-9df4-48cb-bff4-e8e0c4f6e007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:46.793117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513605f7-9df4-48cb-bff4-e8e0c4f6e007 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:46.825837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:46.831865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a96b-3fb1-4c7b-8a36-c3afc17291a0 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:46.865354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b115a8-d660-4ac2-9482-83d908e590b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:46.866242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b115a8-d660-4ac2-9482-83d908e590b4 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:46.866528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b115a8-d660-4ac2-9482-83d908e590b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:46.866805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b115a8-d660-4ac2-9482-83d908e590b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:46.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b115a8-d660-4ac2-9482-83d908e590b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:46.867841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b115a8-d660-4ac2-9482-83d908e590b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:46.869257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b115a8-d660-4ac2-9482-83d908e590b4 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:46.880115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 259/515] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:46.880915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b115a8-d660-4ac2-9482-83d908e590b4 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:46.895445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 257/516] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:46.896279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513605f7-9df4-48cb-bff4-e8e0c4f6e007 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:46.916114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:46.981724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b115a8-d660-4ac2-9482-83d908e590b4 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:46.994498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513605f7-9df4-48cb-bff4-e8e0c4f6e007 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:47.015072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541cf72-018c-4794-b21f-0b264ff8935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:47.015727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541cf72-018c-4794-b21f-0b264ff8935f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:47.016012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541cf72-018c-4794-b21f-0b264ff8935f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:47.016290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541cf72-018c-4794-b21f-0b264ff8935f None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:47.017048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541cf72-018c-4794-b21f-0b264ff8935f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:47.017367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541cf72-018c-4794-b21f-0b264ff8935f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:47.018753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541cf72-018c-4794-b21f-0b264ff8935f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:47.022632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:47.030610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 260/517] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:47.031427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541cf72-018c-4794-b21f-0b264ff8935f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:47.036877 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e8181-25ec-48eb-8028-6a529f974900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:47.037555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e8181-25ec-48eb-8028-6a529f974900 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:47.037840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e8181-25ec-48eb-8028-6a529f974900 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:47.038120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e8181-25ec-48eb-8028-6a529f974900 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:47.039000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e8181-25ec-48eb-8028-6a529f974900 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:47.039318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e8181-25ec-48eb-8028-6a529f974900 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:47.041256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e8181-25ec-48eb-8028-6a529f974900 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:47.080190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 258/518] 10.222.0.13 () {56 vars in 1139 bytes} [Mon Jun 20 05:54:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:47.081046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e8181-25ec-48eb-8028-6a529f974900 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:47.122330 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:47.128842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541cf72-018c-4794-b21f-0b264ff8935f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:47.162358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb095509-b9a2-4900-b7be-e34f88a00680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:47.163134 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095509-b9a2-4900-b7be-e34f88a00680 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:47.163920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095509-b9a2-4900-b7be-e34f88a00680 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:47.164194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095509-b9a2-4900-b7be-e34f88a00680 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:47.171141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb095509-b9a2-4900-b7be-e34f88a00680 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:47.172626 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb095509-b9a2-4900-b7be-e34f88a00680 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:47.180549 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e8181-25ec-48eb-8028-6a529f974900 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-bb095509-b9a2-4900-b7be-e34f88a00680 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:47.187185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:47.188079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:47.189007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:47.189007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:47.189007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:47.189007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:47.189007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:47.189007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:47.189007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:47.189007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:47.189007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:54:47.189007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:47.189007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 261/519] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 20 05:54:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:47.190116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb095509-b9a2-4900-b7be-e34f88a00680 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:47.215133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1956-9b7d-44a6-a9c5-75fe73848b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:47.215920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1956-9b7d-44a6-a9c5-75fe73848b6b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:47.216201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1956-9b7d-44a6-a9c5-75fe73848b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:47.216531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a1956-9b7d-44a6-a9c5-75fe73848b6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:47.223067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a1956-9b7d-44a6-a9c5-75fe73848b6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:47.224528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a1956-9b7d-44a6-a9c5-75fe73848b6b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6e0a1956-9b7d-44a6-a9c5-75fe73848b6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:54:47.239353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:47.240337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:47.241187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:54:47.241187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:54:47.241187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:54:47.241187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:54:47.241187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:54:47.241187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:54:47.241187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:47.241187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:47.241187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 259/520] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:47.241742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1956-9b7d-44a6-a9c5-75fe73848b6b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:47.292734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb095509-b9a2-4900-b7be-e34f88a00680 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:47.293213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:47.328437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d3580-3637-41b4-8abb-93b4a3508b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:47.329227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d3580-3637-41b4-8abb-93b4a3508b08 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:47.329515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d3580-3637-41b4-8abb-93b4a3508b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:47.329791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d3580-3637-41b4-8abb-93b4a3508b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:47.339956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d3580-3637-41b4-8abb-93b4a3508b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:47.341447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d3580-3637-41b4-8abb-93b4a3508b08 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:47.344023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a1956-9b7d-44a6-a9c5-75fe73848b6b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-d99d3580-3637-41b4-8abb-93b4a3508b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:47.363316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:47.364460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:47.365456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:47.365456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:47.365456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:47.365456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:47.365456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 262/521] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:47.365456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d3580-3637-41b4-8abb-93b4a3508b08 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:47.375035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:47.381562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de618ec9-9e4b-4b30-b247-21bf558a1333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:47.382265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618ec9-9e4b-4b30-b247-21bf558a1333 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:47.382549 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618ec9-9e4b-4b30-b247-21bf558a1333 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:47.382830 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de618ec9-9e4b-4b30-b247-21bf558a1333 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:47.383548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de618ec9-9e4b-4b30-b247-21bf558a1333 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:47.385028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de618ec9-9e4b-4b30-b247-21bf558a1333 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:47.404061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 260/522] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:54:47 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:54:47.404906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de618ec9-9e4b-4b30-b247-21bf558a1333 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:47.472816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d3580-3637-41b4-8abb-93b4a3508b08 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:47.508980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d18abb-20cd-400c-bbbc-642d7671f4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:47.509640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18abb-20cd-400c-bbbc-642d7671f4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:47.509925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18abb-20cd-400c-bbbc-642d7671f4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:47.510202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d18abb-20cd-400c-bbbc-642d7671f4f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:47.520676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de618ec9-9e4b-4b30-b247-21bf558a1333 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:47.523928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:47.563340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a812d7f-ca4d-47a3-a1ee-1ff733f8e002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:47.563999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812d7f-ca4d-47a3-a1ee-1ff733f8e002 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:47.564297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812d7f-ca4d-47a3-a1ee-1ff733f8e002 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:47.564593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812d7f-ca4d-47a3-a1ee-1ff733f8e002 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:47.565444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a812d7f-ca4d-47a3-a1ee-1ff733f8e002 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:47.565758 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a812d7f-ca4d-47a3-a1ee-1ff733f8e002 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:47.567216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a812d7f-ca4d-47a3-a1ee-1ff733f8e002 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:47.589576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 261/523] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 20 05:54:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:47.591200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a812d7f-ca4d-47a3-a1ee-1ff733f8e002 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:47.597022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d18abb-20cd-400c-bbbc-642d7671f4f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:47.598529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d18abb-20cd-400c-bbbc-642d7671f4f0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:47.607986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:47.695709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a812d7f-ca4d-47a3-a1ee-1ff733f8e002 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:47.706196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 263/524] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:47.706948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d18abb-20cd-400c-bbbc-642d7671f4f0 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:47.735957 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b229a7-048a-4afb-a7fd-01c16e807edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:47.736646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b229a7-048a-4afb-a7fd-01c16e807edc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:47.736926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b229a7-048a-4afb-a7fd-01c16e807edc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:47.737198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b229a7-048a-4afb-a7fd-01c16e807edc None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:47.737980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b229a7-048a-4afb-a7fd-01c16e807edc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:47.738295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b229a7-048a-4afb-a7fd-01c16e807edc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:47.739721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b229a7-048a-4afb-a7fd-01c16e807edc None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:47.760056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 262/525] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:54:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:47.761246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b229a7-048a-4afb-a7fd-01c16e807edc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:47.789191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:47.814549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d18abb-20cd-400c-bbbc-642d7671f4f0 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:47.822495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:47.851665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c25ed9-d388-4134-9a3c-ba2ee8248beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:47.852570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c25ed9-d388-4134-9a3c-ba2ee8248beb None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:47.852669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c25ed9-d388-4134-9a3c-ba2ee8248beb None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:47.852876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c25ed9-d388-4134-9a3c-ba2ee8248beb None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:47.853598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c25ed9-d388-4134-9a3c-ba2ee8248beb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:47.853907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c25ed9-d388-4134-9a3c-ba2ee8248beb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:47.855285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c25ed9-d388-4134-9a3c-ba2ee8248beb None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:47.868106 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 264/526] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:47.873197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c25ed9-d388-4134-9a3c-ba2ee8248beb None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:47.873786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b229a7-048a-4afb-a7fd-01c16e807edc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:47.914837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842a173-8334-4956-8c94-5112d775b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:47.915658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842a173-8334-4956-8c94-5112d775b219 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:47.915951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842a173-8334-4956-8c94-5112d775b219 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:47.916233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842a173-8334-4956-8c94-5112d775b219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:47.978020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c25ed9-d388-4134-9a3c-ba2ee8248beb None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:47.995121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842a173-8334-4956-8c94-5112d775b219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:47.996636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842a173-8334-4956-8c94-5112d775b219 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:48.013585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f437d-6642-401a-923b-caf8b28572e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:48.014095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f437d-6642-401a-923b-caf8b28572e2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:48.014378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f437d-6642-401a-923b-caf8b28572e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:48.014651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f437d-6642-401a-923b-caf8b28572e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:48.022988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:48.025644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f437d-6642-401a-923b-caf8b28572e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:48.027902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f437d-6642-401a-923b-caf8b28572e2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-968f437d-6642-401a-923b-caf8b28572e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:48.045296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:48.046161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:48.046998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:48.046998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:48.046998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:48.046998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:48.046998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 265/527] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:48.047797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f437d-6642-401a-923b-caf8b28572e2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:48.067856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:48.111397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 263/528] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:48.112239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842a173-8334-4956-8c94-5112d775b219 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:48.155618 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f437d-6642-401a-923b-caf8b28572e2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:48.189652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d842e-f1fa-4072-add8-c734efe8a187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:48.190298 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d842e-f1fa-4072-add8-c734efe8a187 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:48.190580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d842e-f1fa-4072-add8-c734efe8a187 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:48.190850 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d842e-f1fa-4072-add8-c734efe8a187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:48.191690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d842e-f1fa-4072-add8-c734efe8a187 None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=80f36041751a446885608f5a3b1f37df) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:48.192004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d842e-f1fa-4072-add8-c734efe8a187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:48.193468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d842e-f1fa-4072-add8-c734efe8a187 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:48.199604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 266/529] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:48 2022] GET /identity/v3/role_assignments?user.id=80f36041751a446885608f5a3b1f37df&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:48.200393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d842e-f1fa-4072-add8-c734efe8a187 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:48.236840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842a173-8334-4956-8c94-5112d775b219 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:48.271678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:48.291372 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b36a2c-9091-4815-be41-c34fa8581a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:48.292176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b36a2c-9091-4815-be41-c34fa8581a36 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:48.292479 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b36a2c-9091-4815-be41-c34fa8581a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:48.292754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b36a2c-9091-4815-be41-c34fa8581a36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:48.300452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b36a2c-9091-4815-be41-c34fa8581a36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:48.302042 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b36a2c-9091-4815-be41-c34fa8581a36 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:48.311317 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f4b36a2c-9091-4815-be41-c34fa8581a36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:54:48.317137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:48.318115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:48.318978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:54:48.318978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:54:48.318978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:54:48.318978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:54:48.318978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:54:48.318978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:54:48.318978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:48.318978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:48.323114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 264/530] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:48.324348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b36a2c-9091-4815-be41-c34fa8581a36 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:48.340463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d842e-f1fa-4072-add8-c734efe8a187 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:48.384518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2e92-5395-4414-8aad-2b0d94be36eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:48.385111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2e92-5395-4414-8aad-2b0d94be36eb None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:48.385397 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2e92-5395-4414-8aad-2b0d94be36eb None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:48.385677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2e92-5395-4414-8aad-2b0d94be36eb None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:48.386412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c2e92-5395-4414-8aad-2b0d94be36eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:48.386727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c2e92-5395-4414-8aad-2b0d94be36eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:48.388110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c2e92-5395-4414-8aad-2b0d94be36eb None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:48.401587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 267/531] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:48.402565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2e92-5395-4414-8aad-2b0d94be36eb None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:48.461097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b36a2c-9091-4815-be41-c34fa8581a36 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:48.512634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8043b0f-b413-4353-968b-27961a234921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:48.513266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2e92-5395-4414-8aad-2b0d94be36eb None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:48.514002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8043b0f-b413-4353-968b-27961a234921 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:48.514539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8043b0f-b413-4353-968b-27961a234921 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:48.515219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8043b0f-b413-4353-968b-27961a234921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:48.530696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8043b0f-b413-4353-968b-27961a234921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:48.533278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8043b0f-b413-4353-968b-27961a234921 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:48.551790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ca4cf-1a9f-4bf7-ab3c-2614ce1b9880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:48.552490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ca4cf-1a9f-4bf7-ab3c-2614ce1b9880 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:48.552772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ca4cf-1a9f-4bf7-ab3c-2614ce1b9880 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:48.553042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ca4cf-1a9f-4bf7-ab3c-2614ce1b9880 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:48.554415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ca4cf-1a9f-4bf7-ab3c-2614ce1b9880 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:48.554724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ca4cf-1a9f-4bf7-ab3c-2614ce1b9880 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:48.556171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ca4cf-1a9f-4bf7-ab3c-2614ce1b9880 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-b8043b0f-b413-4353-968b-27961a234921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:48.559417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:48.560235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:48.561094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:48.561094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:48.561094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:48.561094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:48.562071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 265/532] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:48.564697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8043b0f-b413-4353-968b-27961a234921 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:48.581564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 268/533] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:54:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:48.581564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ca4cf-1a9f-4bf7-ab3c-2614ce1b9880 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:48.582446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:48.619689 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:48.692949 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ca4cf-1a9f-4bf7-ab3c-2614ce1b9880 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:48.709519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8043b0f-b413-4353-968b-27961a234921 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:48.729475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb1b7-3cd4-4b3c-a2b5-e3220a744db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:48.730312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb1b7-3cd4-4b3c-a2b5-e3220a744db9 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:48.730645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb1b7-3cd4-4b3c-a2b5-e3220a744db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:48.730924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddb1b7-3cd4-4b3c-a2b5-e3220a744db9 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:48.731758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddb1b7-3cd4-4b3c-a2b5-e3220a744db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:48.732064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddb1b7-3cd4-4b3c-a2b5-e3220a744db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:48.733593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cddb1b7-3cd4-4b3c-a2b5-e3220a744db9 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:48.745576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 269/534] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:48.746563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb1b7-3cd4-4b3c-a2b5-e3220a744db9 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:48.753098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc838d3-b51f-4c0b-90fb-c559f7998a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:48.754232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc838d3-b51f-4c0b-90fb-c559f7998a2e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:48.754727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc838d3-b51f-4c0b-90fb-c559f7998a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:48.755194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc838d3-b51f-4c0b-90fb-c559f7998a2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:48.765654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc838d3-b51f-4c0b-90fb-c559f7998a2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:48.768086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc838d3-b51f-4c0b-90fb-c559f7998a2e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-cdc838d3-b51f-4c0b-90fb-c559f7998a2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:54:48.787707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:48.789096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:48.789922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:54:48.789922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:54:48.789922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:54:48.789922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:54:48.789922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:54:48.789922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:54:48.789922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:48.789922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:48.790322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 266/535] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:48.791239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc838d3-b51f-4c0b-90fb-c559f7998a2e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:48.814599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:48.858899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cddb1b7-3cd4-4b3c-a2b5-e3220a744db9 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:48.903507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67334ef8-357b-4a60-971b-0081b6192463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:48.905449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334ef8-357b-4a60-971b-0081b6192463 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:48.905755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334ef8-357b-4a60-971b-0081b6192463 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:48.906467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67334ef8-357b-4a60-971b-0081b6192463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:48.907702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67334ef8-357b-4a60-971b-0081b6192463 None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=e56cc5970ff645e594f50a0a204f44d1) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:48.908058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67334ef8-357b-4a60-971b-0081b6192463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:48.908550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:48.910764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67334ef8-357b-4a60-971b-0081b6192463 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:48.917845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc838d3-b51f-4c0b-90fb-c559f7998a2e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:48.919536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 270/536] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:48 2022] GET /identity/v3/role_assignments?user.id=e56cc5970ff645e594f50a0a204f44d1&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:48.921289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67334ef8-357b-4a60-971b-0081b6192463 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:48.976282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48af561-05b1-40f7-a7c4-9ed049715786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:48.977658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48af561-05b1-40f7-a7c4-9ed049715786 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:48.977936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48af561-05b1-40f7-a7c4-9ed049715786 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:48.978204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48af561-05b1-40f7-a7c4-9ed049715786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:48.994043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48af561-05b1-40f7-a7c4-9ed049715786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:48.995535 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48af561-05b1-40f7-a7c4-9ed049715786 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f48af561-05b1-40f7-a7c4-9ed049715786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:54:49.014330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:49.015215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:49.016051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:54:49.016051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:54:49.016051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:54:49.016051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:54:49.016051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:54:49.016051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:54:49.016051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:49.016051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:49.020387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 267/537] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:49.021812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48af561-05b1-40f7-a7c4-9ed049715786 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:49.090096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67334ef8-357b-4a60-971b-0081b6192463 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:49.136668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:49.159990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66642121-5eaf-4385-a2ba-bc829c277de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:49.160729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642121-5eaf-4385-a2ba-bc829c277de8 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:49.161021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642121-5eaf-4385-a2ba-bc829c277de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:49.161302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66642121-5eaf-4385-a2ba-bc829c277de8 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:49.162107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66642121-5eaf-4385-a2ba-bc829c277de8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:49.162422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66642121-5eaf-4385-a2ba-bc829c277de8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:49.164115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66642121-5eaf-4385-a2ba-bc829c277de8 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:49.180859 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 271/538] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:54:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:49.186755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66642121-5eaf-4385-a2ba-bc829c277de8 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:49.188201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48af561-05b1-40f7-a7c4-9ed049715786 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:49.226203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc5baf-9d0e-49c8-8c7f-26042f9c9991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:49.227151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc5baf-9d0e-49c8-8c7f-26042f9c9991 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:49.227608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc5baf-9d0e-49c8-8c7f-26042f9c9991 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:49.228053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc5baf-9d0e-49c8-8c7f-26042f9c9991 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:49.229791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc5baf-9d0e-49c8-8c7f-26042f9c9991 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:49.230312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc5baf-9d0e-49c8-8c7f-26042f9c9991 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:49.232059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc5baf-9d0e-49c8-8c7f-26042f9c9991 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:49.251532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 268/539] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:49.253075 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc5baf-9d0e-49c8-8c7f-26042f9c9991 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:49.285520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:49.340942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66642121-5eaf-4385-a2ba-bc829c277de8 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:49.398843 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33525aed-499c-4c68-b7bf-7f2d3e541539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:49.399838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525aed-499c-4c68-b7bf-7f2d3e541539 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:49.401745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525aed-499c-4c68-b7bf-7f2d3e541539 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:49.402255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33525aed-499c-4c68-b7bf-7f2d3e541539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:49.403368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33525aed-499c-4c68-b7bf-7f2d3e541539 None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=70b46194590c47c08c8d9d98904a2d98) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:49.403917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33525aed-499c-4c68-b7bf-7f2d3e541539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:49.405644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33525aed-499c-4c68-b7bf-7f2d3e541539 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:49.421450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 272/540] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:49 2022] GET /identity/v3/role_assignments?user.id=70b46194590c47c08c8d9d98904a2d98&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:49.469706 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc5baf-9d0e-49c8-8c7f-26042f9c9991 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:49.479812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be0035-b306-4e25-b258-9a3cba6cf02b None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:49.480127 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be0035-b306-4e25-b258-9a3cba6cf02b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:49.480410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be0035-b306-4e25-b258-9a3cba6cf02b None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:49.482124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 273/541] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:54:49.487748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae2f34-667d-473a-92da-879a70ab7b74 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:49.488062 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae2f34-667d-473a-92da-879a70ab7b74 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:49.488336 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae2f34-667d-473a-92da-879a70ab7b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:49.507780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-15ae2f34-667d-473a-92da-879a70ab7b74 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:49.509471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-15ae2f34-667d-473a-92da-879a70ab7b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:49.548854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9632e9-db9f-4b7e-b9bb-7accb7515c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:49.549521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9632e9-db9f-4b7e-b9bb-7accb7515c73 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:49.549803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9632e9-db9f-4b7e-b9bb-7accb7515c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:49.550075 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9632e9-db9f-4b7e-b9bb-7accb7515c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:49.550921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9632e9-db9f-4b7e-b9bb-7accb7515c73 None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=cbe8aea409c3459f9f7b3c3ef6ff583b) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:49.551234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9632e9-db9f-4b7e-b9bb-7accb7515c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:49.555918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9632e9-db9f-4b7e-b9bb-7accb7515c73 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:49.569837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 269/542] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:49 2022] GET /identity/v3/role_assignments?user.id=cbe8aea409c3459f9f7b3c3ef6ff583b&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:49.588735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:49.601440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 274/543] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:49.627443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9632e9-db9f-4b7e-b9bb-7accb7515c73 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:49.719128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:49.743698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9632e9-db9f-4b7e-b9bb-7accb7515c73 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:49.779073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78939418-cd4b-483f-8534-f4020e7d22d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:49.779919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78939418-cd4b-483f-8534-f4020e7d22d6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:49.780205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78939418-cd4b-483f-8534-f4020e7d22d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:49.780513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78939418-cd4b-483f-8534-f4020e7d22d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:49.791398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78939418-cd4b-483f-8534-f4020e7d22d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-78939418-cd4b-483f-8534-f4020e7d22d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:49.799199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:49.800061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:49.801028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 270/544] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:49.807022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae2f34-667d-473a-92da-879a70ab7b74 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:49.909227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae2f34-667d-473a-92da-879a70ab7b74 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:49.962139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4211aa-e95f-4dc4-abf0-1d76a0392ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:49.962882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4211aa-e95f-4dc4-abf0-1d76a0392ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:49.963170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4211aa-e95f-4dc4-abf0-1d76a0392ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:49.963502 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4211aa-e95f-4dc4-abf0-1d76a0392ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:49.964267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4211aa-e95f-4dc4-abf0-1d76a0392ae2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:49.964675 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4211aa-e95f-4dc4-abf0-1d76a0392ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:49.966034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4211aa-e95f-4dc4-abf0-1d76a0392ae2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:49.980265 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 275/545] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:49.985751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78939418-cd4b-483f-8534-f4020e7d22d6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:50.120859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78939418-cd4b-483f-8534-f4020e7d22d6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:50.170111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568c29d-2f8f-46ea-9273-9f29ef194cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:50.171279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568c29d-2f8f-46ea-9273-9f29ef194cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:50.171778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568c29d-2f8f-46ea-9273-9f29ef194cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:50.172260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568c29d-2f8f-46ea-9273-9f29ef194cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:50.182835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:50.187793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568c29d-2f8f-46ea-9273-9f29ef194cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:50.189388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568c29d-2f8f-46ea-9273-9f29ef194cd6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-9568c29d-2f8f-46ea-9273-9f29ef194cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:50.218027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:50.218937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:50.219769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:50.219769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:50.219769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:50.219769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:50.219769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 271/546] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:50.226572 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4211aa-e95f-4dc4-abf0-1d76a0392ae2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:50.294847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:50.355635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4211aa-e95f-4dc4-abf0-1d76a0392ae2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:50.390248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171fabe-425c-4320-9f9b-e0ec392656a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:50.390919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171fabe-425c-4320-9f9b-e0ec392656a6 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:50.391216 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171fabe-425c-4320-9f9b-e0ec392656a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:50.391501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171fabe-425c-4320-9f9b-e0ec392656a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:50.392248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171fabe-425c-4320-9f9b-e0ec392656a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:50.392587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171fabe-425c-4320-9f9b-e0ec392656a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:50.393995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171fabe-425c-4320-9f9b-e0ec392656a6 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:50.407870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 276/547] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:50.414025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568c29d-2f8f-46ea-9273-9f29ef194cd6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:50.515329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8b7d9-ed19-4ed5-814e-93f035dda979 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:50.515515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8b7d9-ed19-4ed5-814e-93f035dda979 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:50.515805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8b7d9-ed19-4ed5-814e-93f035dda979 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:50.517497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 277/548] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:50.525525 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df8619-6325-4dc2-a585-ca183a6631ca None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:50.526081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df8619-6325-4dc2-a585-ca183a6631ca None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:50.526369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df8619-6325-4dc2-a585-ca183a6631ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:50.551084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d1df8619-6325-4dc2-a585-ca183a6631ca None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:50.552298 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d1df8619-6325-4dc2-a585-ca183a6631ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:50.555852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568c29d-2f8f-46ea-9273-9f29ef194cd6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:50.592827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c8c6d-4828-4f66-bf61-161244d7c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:50.594021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c8c6d-4828-4f66-bf61-161244d7c886 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:50.594504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c8c6d-4828-4f66-bf61-161244d7c886 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:50.594994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c8c6d-4828-4f66-bf61-161244d7c886 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:50.603268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c8c6d-4828-4f66-bf61-161244d7c886 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:50.604960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c8c6d-4828-4f66-bf61-161244d7c886 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-695c8c6d-4828-4f66-bf61-161244d7c886 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:50.621913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:50.623240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:50.624424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:50.624424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:50.624424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:50.624424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:50.624424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:50.624424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:50.624424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:50.624424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:50.624424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:54:50.624424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:50.627107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 272/549] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:54:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:50.633370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c8c6d-4828-4f66-bf61-161244d7c886 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:50.688166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:50.732344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 278/550] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:50.740948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c8c6d-4828-4f66-bf61-161244d7c886 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:50.766488 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df8619-6325-4dc2-a585-ca183a6631ca None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:50.777061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4cee9-671b-40e0-ad8a-d3f05e279ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:50.777976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4cee9-671b-40e0-ad8a-d3f05e279ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:50.778462 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4cee9-671b-40e0-ad8a-d3f05e279ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:50.778937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4cee9-671b-40e0-ad8a-d3f05e279ff8 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:50.780114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4cee9-671b-40e0-ad8a-d3f05e279ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:50.780652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4cee9-671b-40e0-ad8a-d3f05e279ff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:50.782298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4cee9-671b-40e0-ad8a-d3f05e279ff8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:50.801618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 273/551] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 20 05:54:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:50.807837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4cee9-671b-40e0-ad8a-d3f05e279ff8 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:50.830201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:50.915152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4cee9-671b-40e0-ad8a-d3f05e279ff8 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:50.928737 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:50.953771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7ecb2-e569-49a8-a158-484d03249ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:50.954475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df8619-6325-4dc2-a585-ca183a6631ca None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:50.955402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ecb2-e569-49a8-a158-484d03249ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:50.956008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ecb2-e569-49a8-a158-484d03249ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:50.956527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7ecb2-e569-49a8-a158-484d03249ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.007382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd950f2-0ce1-42de-9d6e-4c97b16e411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:51.008002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd950f2-0ce1-42de-9d6e-4c97b16e411c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:51.008291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd950f2-0ce1-42de-9d6e-4c97b16e411c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:51.016723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd950f2-0ce1-42de-9d6e-4c97b16e411c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.027648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd950f2-0ce1-42de-9d6e-4c97b16e411c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:51.031380 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7ecb2-e569-49a8-a158-484d03249ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:51.033455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7ecb2-e569-49a8-a158-484d03249ed4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-6fd950f2-0ce1-42de-9d6e-4c97b16e411c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:51.044099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:51.045239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:51.046150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 279/552] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:51.051357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd950f2-0ce1-42de-9d6e-4c97b16e411c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:51.143465 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 274/553] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:51.149186 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7ecb2-e569-49a8-a158-484d03249ed4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:51.160671 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:51.208434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:51.220175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd950f2-0ce1-42de-9d6e-4c97b16e411c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:51.284467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f85c4-54ff-4c63-8359-e882b8c88037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:51.285075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f85c4-54ff-4c63-8359-e882b8c88037 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:51.285364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f85c4-54ff-4c63-8359-e882b8c88037 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:51.285643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f85c4-54ff-4c63-8359-e882b8c88037 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.286405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f85c4-54ff-4c63-8359-e882b8c88037 None admin] RBAC: Adding query filter params (name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:51.286721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f85c4-54ff-4c63-8359-e882b8c88037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:51.288142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f85c4-54ff-4c63-8359-e882b8c88037 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:51.307715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7ecb2-e569-49a8-a158-484d03249ed4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:51.310056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 280/554] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:51.310966 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f85c4-54ff-4c63-8359-e882b8c88037 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:51.359812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ba49-f723-412c-baa2-077bbead583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:51.360657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ba49-f723-412c-baa2-077bbead583b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:51.360952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ba49-f723-412c-baa2-077bbead583b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:51.361235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98ba49-f723-412c-baa2-077bbead583b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.380350 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98ba49-f723-412c-baa2-077bbead583b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:51.381849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d98ba49-f723-412c-baa2-077bbead583b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-5d98ba49-f723-412c-baa2-077bbead583b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:51.413898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:51.414894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:51.415740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:51.415740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:51.415740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:51.415740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:51.415740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 275/555] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:51.427769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ba49-f723-412c-baa2-077bbead583b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:51.513041 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f85c4-54ff-4c63-8359-e882b8c88037 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:51.536762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:51.575070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409d668-a3d0-4421-aa4c-8cdcce85b6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:51.575865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409d668-a3d0-4421-aa4c-8cdcce85b6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:51.576146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409d668-a3d0-4421-aa4c-8cdcce85b6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:51.576441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409d668-a3d0-4421-aa4c-8cdcce85b6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.591958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409d668-a3d0-4421-aa4c-8cdcce85b6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:51.593460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409d668-a3d0-4421-aa4c-8cdcce85b6e6 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:51.600002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98ba49-f723-412c-baa2-077bbead583b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-7409d668-a3d0-4421-aa4c-8cdcce85b6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:51.640360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:51.641285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:51.642630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:51.642630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:51.642630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:51.642630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:51.642855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180ded7-2bc8-44b0-88e0-39243ab55bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:51.642855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180ded7-2bc8-44b0-88e0-39243ab55bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:51.642855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180ded7-2bc8-44b0-88e0-39243ab55bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:51.642855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180ded7-2bc8-44b0-88e0-39243ab55bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.643111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180ded7-2bc8-44b0-88e0-39243ab55bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:51.643688 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180ded7-2bc8-44b0-88e0-39243ab55bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:51.644781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180ded7-2bc8-44b0-88e0-39243ab55bd5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:51.649046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 281/556] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:51.654263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409d668-a3d0-4421-aa4c-8cdcce85b6e6 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:51.657925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 276/557] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:51.662895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180ded7-2bc8-44b0-88e0-39243ab55bd5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:51.677615 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:51.797318 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409d668-a3d0-4421-aa4c-8cdcce85b6e6 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:51.805048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180ded7-2bc8-44b0-88e0-39243ab55bd5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:51.828617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:51.841170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68903961-fd25-436c-a011-299647881c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:51.842205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68903961-fd25-436c-a011-299647881c7c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:51.842599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68903961-fd25-436c-a011-299647881c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:51.842891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68903961-fd25-436c-a011-299647881c7c None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.843832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68903961-fd25-436c-a011-299647881c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:51.844257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68903961-fd25-436c-a011-299647881c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:51.845482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859049d-736a-46eb-b5a2-c5861e825686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:51.845832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68903961-fd25-436c-a011-299647881c7c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:51.846364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859049d-736a-46eb-b5a2-c5861e825686 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:51.846654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859049d-736a-46eb-b5a2-c5861e825686 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:51.846983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859049d-736a-46eb-b5a2-c5861e825686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.855493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859049d-736a-46eb-b5a2-c5861e825686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:51.857129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859049d-736a-46eb-b5a2-c5861e825686 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:51.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 282/558] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:51.861559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0c5c5-c46f-4c04-8d5b-da2e9292069b None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:51.861853 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0c5c5-c46f-4c04-8d5b-da2e9292069b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:51.862131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0c5c5-c46f-4c04-8d5b-da2e9292069b None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.863683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 283/559] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:51.864774 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3d8b-e183-450f-bc6c-088272107091 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:51.865059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3d8b-e183-450f-bc6c-088272107091 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:51.865337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3d8b-e183-450f-bc6c-088272107091 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.866729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 284/560] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:51.867304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd3d8b-e183-450f-bc6c-088272107091 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-2859049d-736a-46eb-b5a2-c5861e825686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:54:51.876008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:51.877103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:51.878039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:54:51.878039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:54:51.878039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:54:51.878039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:54:51.878039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:54:51.878039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:54:51.878039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:51.878039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:51.878039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 277/561] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:51.878663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e6672-5bea-4ac9-979d-184c4870044b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:51.878950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e6672-5bea-4ac9-979d-184c4870044b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:51.879226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e6672-5bea-4ac9-979d-184c4870044b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.897095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-dd5e6672-5bea-4ac9-979d-184c4870044b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:51.898834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dd5e6672-5bea-4ac9-979d-184c4870044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:51.944892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:51.976345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 278/562] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:51.976345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988716-911b-47eb-957f-192dc6052157 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:51.976345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988716-911b-47eb-957f-192dc6052157 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:51.976345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988716-911b-47eb-957f-192dc6052157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:51.989965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fd988716-911b-47eb-957f-192dc6052157 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:51.991666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fd988716-911b-47eb-957f-192dc6052157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:51.995512 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd3d8b-e183-450f-bc6c-088272107091 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:52.033309 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01e96e-5f22-460a-b1e4-2c26a7714799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:52.034122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e96e-5f22-460a-b1e4-2c26a7714799 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.034406 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e96e-5f22-460a-b1e4-2c26a7714799 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.034680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e96e-5f22-460a-b1e4-2c26a7714799 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.042042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01e96e-5f22-460a-b1e4-2c26a7714799 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:52.043739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01e96e-5f22-460a-b1e4-2c26a7714799 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-7e01e96e-5f22-460a-b1e4-2c26a7714799 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:52.058974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:52.059914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 285/563] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:52.061515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01e96e-5f22-460a-b1e4-2c26a7714799 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:52.073530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 279/564] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:52.082244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd988716-911b-47eb-957f-192dc6052157 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:52.115994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:52.171024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01e96e-5f22-460a-b1e4-2c26a7714799 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:52.171494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd988716-911b-47eb-957f-192dc6052157 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:52.195493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:52.203972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c7099-f1cd-4ff7-98ee-489542b7f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:52.204505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185f1c8-0e8b-4a5d-bcd2-51eab588fa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:52.204795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c7099-f1cd-4ff7-98ee-489542b7f318 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.205082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c7099-f1cd-4ff7-98ee-489542b7f318 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.205171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185f1c8-0e8b-4a5d-bcd2-51eab588fa44 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.205359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c7099-f1cd-4ff7-98ee-489542b7f318 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.205447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185f1c8-0e8b-4a5d-bcd2-51eab588fa44 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.205683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185f1c8-0e8b-4a5d-bcd2-51eab588fa44 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.206469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185f1c8-0e8b-4a5d-bcd2-51eab588fa44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:52.206774 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185f1c8-0e8b-4a5d-bcd2-51eab588fa44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:52.208209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185f1c8-0e8b-4a5d-bcd2-51eab588fa44 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:52.216077 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c7099-f1cd-4ff7-98ee-489542b7f318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:52.219766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 286/565] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:52.220556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185f1c8-0e8b-4a5d-bcd2-51eab588fa44 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-304c7099-f1cd-4ff7-98ee-489542b7f318 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:52.223817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:52.224805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:52.225835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 280/566] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:52.226680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f2020-03f7-4ae1-9e7b-e77009c4c9a7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.226761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f2020-03f7-4ae1-9e7b-e77009c4c9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.226998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f2020-03f7-4ae1-9e7b-e77009c4c9a7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.228408 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 281/567] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:52.232966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f2020-03f7-4ae1-9e7b-e77009c4c9a7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:52.324037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185f1c8-0e8b-4a5d-bcd2-51eab588fa44 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:52.335941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:52.340638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f2020-03f7-4ae1-9e7b-e77009c4c9a7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:52.356825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625f470-9d84-401c-93f9-067c3230cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:52.357493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f470-9d84-401c-93f9-067c3230cf94 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.357779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f470-9d84-401c-93f9-067c3230cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.358059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625f470-9d84-401c-93f9-067c3230cf94 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.358906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625f470-9d84-401c-93f9-067c3230cf94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:52.359219 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625f470-9d84-401c-93f9-067c3230cf94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:52.360701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625f470-9d84-401c-93f9-067c3230cf94 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:52.373274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25847bc5-64bf-4b49-b4ca-2c0de58bcf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:52.374051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25847bc5-64bf-4b49-b4ca-2c0de58bcf19 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.374332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25847bc5-64bf-4b49-b4ca-2c0de58bcf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.374607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25847bc5-64bf-4b49-b4ca-2c0de58bcf19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.378032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 287/568] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:52.378634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625f470-9d84-401c-93f9-067c3230cf94 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:52.385138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25847bc5-64bf-4b49-b4ca-2c0de58bcf19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-25847bc5-64bf-4b49-b4ca-2c0de58bcf19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:52.392726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:52.393722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:52.394757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 282/569] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:52.395651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25847bc5-64bf-4b49-b4ca-2c0de58bcf19 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:52.428889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:52.481120 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625f470-9d84-401c-93f9-067c3230cf94 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:52.490942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25847bc5-64bf-4b49-b4ca-2c0de58bcf19 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:52.513501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3f74c-c214-4aad-bd45-0076c1b6dfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:52.514150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3f74c-c214-4aad-bd45-0076c1b6dfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.514430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3f74c-c214-4aad-bd45-0076c1b6dfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.514702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3f74c-c214-4aad-bd45-0076c1b6dfe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.515523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3f74c-c214-4aad-bd45-0076c1b6dfe1 None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=265894b988a640f0b17846d4986b670a) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:52.515832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3f74c-c214-4aad-bd45-0076c1b6dfe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:52.517289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3f74c-c214-4aad-bd45-0076c1b6dfe1 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:52.522600 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 288/570] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/role_assignments?user.id=265894b988a640f0b17846d4986b670a&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:52.523738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a649e-b522-4c79-8212-323cee162b1a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.524020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a649e-b522-4c79-8212-323cee162b1a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.524294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a649e-b522-4c79-8212-323cee162b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.527697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ecc03-6065-4525-a80b-77fb223dbf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:52.528400 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ecc03-6065-4525-a80b-77fb223dbf4a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.528681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ecc03-6065-4525-a80b-77fb223dbf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.528954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ecc03-6065-4525-a80b-77fb223dbf4a None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.529725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ecc03-6065-4525-a80b-77fb223dbf4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:52.530047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ecc03-6065-4525-a80b-77fb223dbf4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:52.531474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ecc03-6065-4525-a80b-77fb223dbf4a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:52.546194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 283/571] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:52.546194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ecc03-6065-4525-a80b-77fb223dbf4a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:52.547863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-807a649e-b522-4c79-8212-323cee162b1a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:52.549150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-807a649e-b522-4c79-8212-323cee162b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:52.575314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:52.622831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 289/572] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:52.623700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a649e-b522-4c79-8212-323cee162b1a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:52.668441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ecc03-6065-4525-a80b-77fb223dbf4a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:52.669542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:52.706694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de6c83-fa90-425f-94a6-0ef4b50a5472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:52.707490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de6c83-fa90-425f-94a6-0ef4b50a5472 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.707774 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de6c83-fa90-425f-94a6-0ef4b50a5472 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.708051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de6c83-fa90-425f-94a6-0ef4b50a5472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.720292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de6c83-fa90-425f-94a6-0ef4b50a5472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:52.721766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de6c83-fa90-425f-94a6-0ef4b50a5472 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:52.734051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a649e-b522-4c79-8212-323cee162b1a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e9de6c83-fa90-425f-94a6-0ef4b50a5472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:52.741299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:52.742438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:52.743322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:52.743322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:52.743322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:52.743322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:52.743322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 284/573] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:52.743322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de6c83-fa90-425f-94a6-0ef4b50a5472 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:52.778334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a713d-87bf-40b6-afe1-bdc5148c38dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:52.780245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a713d-87bf-40b6-afe1-bdc5148c38dc None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.780707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a713d-87bf-40b6-afe1-bdc5148c38dc None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.781158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a713d-87bf-40b6-afe1-bdc5148c38dc None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.782138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a713d-87bf-40b6-afe1-bdc5148c38dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:52.782599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a713d-87bf-40b6-afe1-bdc5148c38dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:52.784650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a713d-87bf-40b6-afe1-bdc5148c38dc None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:52.795536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 290/574] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:52.796561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a713d-87bf-40b6-afe1-bdc5148c38dc None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:52.819682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:52.846853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de6c83-fa90-425f-94a6-0ef4b50a5472 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:52.883273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858b2d2-a61a-4451-99f1-3d8baa210c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:52.884299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b2d2-a61a-4451-99f1-3d8baa210c78 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.884778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b2d2-a61a-4451-99f1-3d8baa210c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.885204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b2d2-a61a-4451-99f1-3d8baa210c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.896613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858b2d2-a61a-4451-99f1-3d8baa210c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:52.898119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858b2d2-a61a-4451-99f1-3d8baa210c78 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:52.904094 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:52.906937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a713d-87bf-40b6-afe1-bdc5148c38dc None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4858b2d2-a61a-4451-99f1-3d8baa210c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:52.916229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:52.917171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:52.923103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:52.923103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:52.923103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:52.923103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:52.923103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 285/575] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:52.923103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858b2d2-a61a-4451-99f1-3d8baa210c78 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:52.950329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681edc60-d4ea-450a-a1e3-d421e4d021a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:52.951133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681edc60-d4ea-450a-a1e3-d421e4d021a2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:52.951425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681edc60-d4ea-450a-a1e3-d421e4d021a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:52.951708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681edc60-d4ea-450a-a1e3-d421e4d021a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:52.964657 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681edc60-d4ea-450a-a1e3-d421e4d021a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-681edc60-d4ea-450a-a1e3-d421e4d021a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:52.972470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:52.973424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:52.974251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 291/576] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:52.974920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681edc60-d4ea-450a-a1e3-d421e4d021a2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.031355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858b2d2-a61a-4451-99f1-3d8baa210c78 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:53.059547 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:53.076678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc5b54-0410-42ee-9f48-ce473bc2ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:53.078051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc5b54-0410-42ee-9f48-ce473bc2ba8c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:53.078517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc5b54-0410-42ee-9f48-ce473bc2ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:53.079007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc5b54-0410-42ee-9f48-ce473bc2ba8c None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:53.079813 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc5b54-0410-42ee-9f48-ce473bc2ba8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:53.080194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc5b54-0410-42ee-9f48-ce473bc2ba8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:53.081587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc5b54-0410-42ee-9f48-ce473bc2ba8c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:53.081989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681edc60-d4ea-450a-a1e3-d421e4d021a2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:53.099250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 286/577] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:53.099250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc5b54-0410-42ee-9f48-ce473bc2ba8c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.121762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5de7b-889e-43b1-9451-51a75c4eabde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:53.122557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5de7b-889e-43b1-9451-51a75c4eabde None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:53.122836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5de7b-889e-43b1-9451-51a75c4eabde None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:53.123106 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5de7b-889e-43b1-9451-51a75c4eabde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:53.135886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5de7b-889e-43b1-9451-51a75c4eabde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:53.137373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5de7b-889e-43b1-9451-51a75c4eabde None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-10f5de7b-889e-43b1-9451-51a75c4eabde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:53.155464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:53.156416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:53.157300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:53.157300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:53.157300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:53.157300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:53.160462 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 292/578] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:53.161914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5de7b-889e-43b1-9451-51a75c4eabde None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.176906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:53.204078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc5b54-0410-42ee-9f48-ce473bc2ba8c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:53.241816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936dce-9a5c-4994-921f-54c2cb143c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:53.244666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936dce-9a5c-4994-921f-54c2cb143c49 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:53.244666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936dce-9a5c-4994-921f-54c2cb143c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:53.244666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68936dce-9a5c-4994-921f-54c2cb143c49 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:53.244666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68936dce-9a5c-4994-921f-54c2cb143c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:53.244666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68936dce-9a5c-4994-921f-54c2cb143c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:53.245902 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68936dce-9a5c-4994-921f-54c2cb143c49 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:53.257407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 287/579] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:53.258057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936dce-9a5c-4994-921f-54c2cb143c49 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.283461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5de7b-889e-43b1-9451-51a75c4eabde None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:53.307339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:53.319753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b2d04-ea56-4d4f-ac5e-268ac7a94e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:53.320455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b2d04-ea56-4d4f-ac5e-268ac7a94e62 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:53.320743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b2d04-ea56-4d4f-ac5e-268ac7a94e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:53.321026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b2d04-ea56-4d4f-ac5e-268ac7a94e62 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:53.321779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b2d04-ea56-4d4f-ac5e-268ac7a94e62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:53.322093 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b2d04-ea56-4d4f-ac5e-268ac7a94e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:53.323459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b2d04-ea56-4d4f-ac5e-268ac7a94e62 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:53.332243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 293/580] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:53.332894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b2d04-ea56-4d4f-ac5e-268ac7a94e62 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.373059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68936dce-9a5c-4994-921f-54c2cb143c49 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:53.408683 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0bfcb-4e49-47c0-819e-fd173b7cc075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:53.409470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0bfcb-4e49-47c0-819e-fd173b7cc075 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:53.409750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0bfcb-4e49-47c0-819e-fd173b7cc075 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:53.410021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0bfcb-4e49-47c0-819e-fd173b7cc075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:53.414377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:53.419055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0bfcb-4e49-47c0-819e-fd173b7cc075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:53.420547 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0bfcb-4e49-47c0-819e-fd173b7cc075 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-62b0bfcb-4e49-47c0-819e-fd173b7cc075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:54:53.434726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:53.435836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:53.441673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:54:53.441673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:54:53.441673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:54:53.441673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:54:53.441673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:54:53.441673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:54:53.441673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:53.441673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:53.441673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 288/581] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:53.441673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0bfcb-4e49-47c0-819e-fd173b7cc075 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.447670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b2d04-ea56-4d4f-ac5e-268ac7a94e62 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:53.484012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405f54-074a-42db-a60c-45911edb984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:53.484707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405f54-074a-42db-a60c-45911edb984f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:53.484995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405f54-074a-42db-a60c-45911edb984f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:53.485274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405f54-074a-42db-a60c-45911edb984f None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:53.486008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08405f54-074a-42db-a60c-45911edb984f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:53.486321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08405f54-074a-42db-a60c-45911edb984f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:53.487690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08405f54-074a-42db-a60c-45911edb984f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:53.504095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 294/582] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:53.504095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405f54-074a-42db-a60c-45911edb984f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.545999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0bfcb-4e49-47c0-819e-fd173b7cc075 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:53.554680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:53.587030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c8019-7ffa-4a90-a2ca-8e67bcc51c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:53.587818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c8019-7ffa-4a90-a2ca-8e67bcc51c78 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:53.588105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c8019-7ffa-4a90-a2ca-8e67bcc51c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:53.588418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c8019-7ffa-4a90-a2ca-8e67bcc51c78 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:53.595666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c8019-7ffa-4a90-a2ca-8e67bcc51c78 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:53.597157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c8019-7ffa-4a90-a2ca-8e67bcc51c78 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:53.609381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405f54-074a-42db-a60c-45911edb984f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-ea3c8019-7ffa-4a90-a2ca-8e67bcc51c78 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:53.613105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:53.614280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:53.615448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:53.615448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:53.615448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:53.615448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:53.615448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:53.615448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:53.615448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:53.615448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:53.615448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:54:53.615448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:53.618160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 289/583] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:53.619192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c8019-7ffa-4a90-a2ca-8e67bcc51c78 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.652236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da5248-5115-496d-a55a-0843b57e2961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:53.653364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5248-5115-496d-a55a-0843b57e2961 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:53.653810 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5248-5115-496d-a55a-0843b57e2961 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:53.654092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5248-5115-496d-a55a-0843b57e2961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:53.656089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:53.666238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da5248-5115-496d-a55a-0843b57e2961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:53.668206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da5248-5115-496d-a55a-0843b57e2961 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-69da5248-5115-496d-a55a-0843b57e2961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:53.685936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:53.686830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:53.687721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:53.687721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:53.687721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:53.687721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:53.687721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 295/584] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:53.687993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da5248-5115-496d-a55a-0843b57e2961 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.734661 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c8019-7ffa-4a90-a2ca-8e67bcc51c78 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:53.771781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bca3e-a7b2-4112-8ac8-6209772afd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:53.772523 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bca3e-a7b2-4112-8ac8-6209772afd05 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:53.772811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bca3e-a7b2-4112-8ac8-6209772afd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:53.773094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bca3e-a7b2-4112-8ac8-6209772afd05 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:53.773884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bca3e-a7b2-4112-8ac8-6209772afd05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:53.774202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bca3e-a7b2-4112-8ac8-6209772afd05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:53.775970 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bca3e-a7b2-4112-8ac8-6209772afd05 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:53.787320 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 290/585] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:54:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:53.788648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bca3e-a7b2-4112-8ac8-6209772afd05 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.806043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da5248-5115-496d-a55a-0843b57e2961 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:53.815625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:53.844748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b19d5-56c9-4a8a-8a34-ec93082f71a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:53.846116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b19d5-56c9-4a8a-8a34-ec93082f71a5 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:53.846827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b19d5-56c9-4a8a-8a34-ec93082f71a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:53.847692 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b19d5-56c9-4a8a-8a34-ec93082f71a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:53.856185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b19d5-56c9-4a8a-8a34-ec93082f71a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:53.857745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b19d5-56c9-4a8a-8a34-ec93082f71a5 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-db2b19d5-56c9-4a8a-8a34-ec93082f71a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:53.872224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:53.873191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:53.874115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:53.874115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:53.874115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:53.874115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:53.874115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:53.874115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:53.874115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:53.874115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:53.874115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:54:53.874115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:53.874115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 296/586] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:53.874722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b19d5-56c9-4a8a-8a34-ec93082f71a5 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.904132 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bca3e-a7b2-4112-8ac8-6209772afd05 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:53.927684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:53.939630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684e807-af86-4911-a1a8-c649b9e4fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:53.940298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e807-af86-4911-a1a8-c649b9e4fef0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:53.940613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e807-af86-4911-a1a8-c649b9e4fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:53.940891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e807-af86-4911-a1a8-c649b9e4fef0 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:53.941730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684e807-af86-4911-a1a8-c649b9e4fef0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:53.942047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684e807-af86-4911-a1a8-c649b9e4fef0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:53.943484 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684e807-af86-4911-a1a8-c649b9e4fef0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:53.964349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 291/587] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 20 05:54:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:53.964349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684e807-af86-4911-a1a8-c649b9e4fef0 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:53.993943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b19d5-56c9-4a8a-8a34-ec93082f71a5 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:54.031252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d20ea-7ea5-45e4-a502-81acc539f0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:54.031910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d20ea-7ea5-45e4-a502-81acc539f0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.032194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d20ea-7ea5-45e4-a502-81acc539f0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.032509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d20ea-7ea5-45e4-a502-81acc539f0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.033242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d20ea-7ea5-45e4-a502-81acc539f0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:54.033966 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d20ea-7ea5-45e4-a502-81acc539f0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:54.034935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d20ea-7ea5-45e4-a502-81acc539f0b8 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:54.052097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 297/588] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:54.052097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d20ea-7ea5-45e4-a502-81acc539f0b8 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:54.055587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:54.069475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684e807-af86-4911-a1a8-c649b9e4fef0 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:54.105616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e01cb1-f067-4314-bf5d-b9bfbaa700db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:54.106602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e01cb1-f067-4314-bf5d-b9bfbaa700db None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.106965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e01cb1-f067-4314-bf5d-b9bfbaa700db None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.107245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e01cb1-f067-4314-bf5d-b9bfbaa700db None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/80f36041751a446885608f5a3b1f37df/roles/3b8809a605ba4173b9b96a4ef54212a2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.121515 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e01cb1-f067-4314-bf5d-b9bfbaa700db None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=80f36041751a446885608f5a3b1f37df, role_id=3b8809a605ba4173b9b96a4ef54212a2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:54.122963 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e01cb1-f067-4314-bf5d-b9bfbaa700db None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:54.136563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 292/589] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:54:53 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/80f36041751a446885608f5a3b1f37df/roles/3b8809a605ba4173b9b96a4ef54212a2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:54:54.141352 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e01cb1-f067-4314-bf5d-b9bfbaa700db None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:54.170539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d20ea-7ea5-45e4-a502-81acc539f0b8 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:54.179283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:54.211642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb197a-0f8e-4dba-8ca2-9e7dd7d06cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:54.212577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb197a-0f8e-4dba-8ca2-9e7dd7d06cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.212979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb197a-0f8e-4dba-8ca2-9e7dd7d06cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.213285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb197a-0f8e-4dba-8ca2-9e7dd7d06cf0 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.214490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb197a-0f8e-4dba-8ca2-9e7dd7d06cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:54.214607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb197a-0f8e-4dba-8ca2-9e7dd7d06cf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:54.216202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb197a-0f8e-4dba-8ca2-9e7dd7d06cf0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:54.239837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 298/590] 10.222.0.13 () {56 vars in 1139 bytes} [Mon Jun 20 05:54:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:54.240897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb197a-0f8e-4dba-8ca2-9e7dd7d06cf0 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:54.273045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e01cb1-f067-4314-bf5d-b9bfbaa700db None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:54.311939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f4f0d-be5e-4a52-88d5-511f7d7c28d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:54.313134 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4f0d-be5e-4a52-88d5-511f7d7c28d9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.313624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4f0d-be5e-4a52-88d5-511f7d7c28d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.314103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f4f0d-be5e-4a52-88d5-511f7d7c28d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.316348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:54.328744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f4f0d-be5e-4a52-88d5-511f7d7c28d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:54.331173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f4f0d-be5e-4a52-88d5-511f7d7c28d9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-fa8f4f0d-be5e-4a52-88d5-511f7d7c28d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:54.355027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:54.355976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:54.356895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:54.356895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:54.356895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:54.356895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:54.356895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 293/591] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:54.357164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f4f0d-be5e-4a52-88d5-511f7d7c28d9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:54.358681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb197a-0f8e-4dba-8ca2-9e7dd7d06cf0 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:54.406719 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9f2ad-c28c-40ae-8606-50e6366c5273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:54.408227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9f2ad-c28c-40ae-8606-50e6366c5273 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.408759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9f2ad-c28c-40ae-8606-50e6366c5273 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.409546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9f2ad-c28c-40ae-8606-50e6366c5273 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.419801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9f2ad-c28c-40ae-8606-50e6366c5273 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:54.422410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9f2ad-c28c-40ae-8606-50e6366c5273 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-98b9f2ad-c28c-40ae-8606-50e6366c5273 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:54.442070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:54.443039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:54.443946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:54.443946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:54.443946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:54.443946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:54.443946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:54.443946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:54.443946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:54.443946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:54.443946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:54:54.443946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:54.446179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 299/592] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 20 05:54:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:54.451305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9f2ad-c28c-40ae-8606-50e6366c5273 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:54.476150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f4f0d-be5e-4a52-88d5-511f7d7c28d9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:54.477809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:54.512741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec9f11-c0ca-4a13-94b1-2aaa838c2289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:54.513892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec9f11-c0ca-4a13-94b1-2aaa838c2289 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.514422 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec9f11-c0ca-4a13-94b1-2aaa838c2289 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.514897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec9f11-c0ca-4a13-94b1-2aaa838c2289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.526567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec9f11-c0ca-4a13-94b1-2aaa838c2289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:54.528384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec9f11-c0ca-4a13-94b1-2aaa838c2289 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6eec9f11-c0ca-4a13-94b1-2aaa838c2289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:54.546805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:54.547722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:54.548649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:54.548649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:54.548649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:54.548649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:54.550849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 294/593] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:54.551942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec9f11-c0ca-4a13-94b1-2aaa838c2289 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:54.558364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9f2ad-c28c-40ae-8606-50e6366c5273 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:54.594151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:54.598152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485cadb-0d42-4812-8072-a0b22238aebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:54.598927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485cadb-0d42-4812-8072-a0b22238aebe None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.599309 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485cadb-0d42-4812-8072-a0b22238aebe None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.599732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485cadb-0d42-4812-8072-a0b22238aebe None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.600565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485cadb-0d42-4812-8072-a0b22238aebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:54.600943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485cadb-0d42-4812-8072-a0b22238aebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:54.602388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485cadb-0d42-4812-8072-a0b22238aebe None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:54.616258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 300/594] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:54.617534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485cadb-0d42-4812-8072-a0b22238aebe None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:54.660437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec9f11-c0ca-4a13-94b1-2aaa838c2289 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:54.697304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a03bef-afae-4ec0-a473-3d8ba72d1f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:54.697895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a03bef-afae-4ec0-a473-3d8ba72d1f14 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.698179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a03bef-afae-4ec0-a473-3d8ba72d1f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.698456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a03bef-afae-4ec0-a473-3d8ba72d1f14 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.699298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a03bef-afae-4ec0-a473-3d8ba72d1f14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:54.699614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a03bef-afae-4ec0-a473-3d8ba72d1f14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:54.701501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a03bef-afae-4ec0-a473-3d8ba72d1f14 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:54.710472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:54.721763 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 295/595] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 20 05:54:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:54.727171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3868876-6e71-41bd-b5a3-89e050c475b7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.727461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3868876-6e71-41bd-b5a3-89e050c475b7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.727740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3868876-6e71-41bd-b5a3-89e050c475b7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.728425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485cadb-0d42-4812-8072-a0b22238aebe None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:54.729171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 296/596] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:54.729736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3868876-6e71-41bd-b5a3-89e050c475b7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:54.773681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079f7ae-6da7-486d-a4d9-ea207ba05ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:54.774440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f7ae-6da7-486d-a4d9-ea207ba05ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.774805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f7ae-6da7-486d-a4d9-ea207ba05ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.775189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f7ae-6da7-486d-a4d9-ea207ba05ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.776227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079f7ae-6da7-486d-a4d9-ea207ba05ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:54.776632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079f7ae-6da7-486d-a4d9-ea207ba05ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:54.778192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079f7ae-6da7-486d-a4d9-ea207ba05ac6 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:54.795290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 301/597] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:54.795290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079f7ae-6da7-486d-a4d9-ea207ba05ac6 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:54.837288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:54.845561 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3868876-6e71-41bd-b5a3-89e050c475b7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:54.881441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dc961-ec20-4566-bf6a-798cc5316018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:54.882891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dc961-ec20-4566-bf6a-798cc5316018 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.883242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dc961-ec20-4566-bf6a-798cc5316018 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.883583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dc961-ec20-4566-bf6a-798cc5316018 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.890679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073dc961-ec20-4566-bf6a-798cc5316018 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:54.892207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073dc961-ec20-4566-bf6a-798cc5316018 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:54.902107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079f7ae-6da7-486d-a4d9-ea207ba05ac6 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-073dc961-ec20-4566-bf6a-798cc5316018 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:54:54.906494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:54.907534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:54.908654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:54:54.908654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:54:54.908654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:54:54.908654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:54:54.908654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:54:54.908654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:54:54.908654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:54.908654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:54.914211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 297/598] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:54.914211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f0a6f-d900-4d82-a195-1ab5fc201084 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.914211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f0a6f-d900-4d82-a195-1ab5fc201084 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.914211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f0a6f-d900-4d82-a195-1ab5fc201084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.930158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-519f0a6f-d900-4d82-a195-1ab5fc201084 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:54.931448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-519f0a6f-d900-4d82-a195-1ab5fc201084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:54.942237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bad6e-827a-4193-a6b3-b618461b8e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:54.943098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bad6e-827a-4193-a6b3-b618461b8e96 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:54.943447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bad6e-827a-4193-a6b3-b618461b8e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:54.943794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bad6e-827a-4193-a6b3-b618461b8e96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:54.955694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bad6e-827a-4193-a6b3-b618461b8e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:54.957843 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bad6e-827a-4193-a6b3-b618461b8e96 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:54.961172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-e74bad6e-827a-4193-a6b3-b618461b8e96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:54.981497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:54.982399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:54.983722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:54.983722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:54.983722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:54.983722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:54.983722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 302/599] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:54.984168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bad6e-827a-4193-a6b3-b618461b8e96 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:55.008368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 298/600] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:55.008368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f0a6f-d900-4d82-a195-1ab5fc201084 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:55.092867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:55.108279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f0a6f-d900-4d82-a195-1ab5fc201084 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:55.108882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bad6e-827a-4193-a6b3-b618461b8e96 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:55.143562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652398-2ad0-40f1-85e4-38db0ba9e200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:55.144408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652398-2ad0-40f1-85e4-38db0ba9e200 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:55.144665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652398-2ad0-40f1-85e4-38db0ba9e200 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:55.144933 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652398-2ad0-40f1-85e4-38db0ba9e200 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:55.145979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81f978-6c5e-4096-b7c6-409777ea807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:55.146681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f978-6c5e-4096-b7c6-409777ea807f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:55.146917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f978-6c5e-4096-b7c6-409777ea807f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:55.147204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f978-6c5e-4096-b7c6-409777ea807f None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:55.148013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81f978-6c5e-4096-b7c6-409777ea807f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:55.148336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81f978-6c5e-4096-b7c6-409777ea807f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:55.149823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81f978-6c5e-4096-b7c6-409777ea807f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:55.152080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b652398-2ad0-40f1-85e4-38db0ba9e200 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:55.153538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b652398-2ad0-40f1-85e4-38db0ba9e200 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:55.166841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 299/601] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:54:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:55.166841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81f978-6c5e-4096-b7c6-409777ea807f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-2b652398-2ad0-40f1-85e4-38db0ba9e200 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:54:55.168612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:55.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:55.170528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:54:55.170528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:54:55.170528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:54:55.170528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:54:55.170528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:54:55.170528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:54:55.170528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:55.170528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:55.170528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 303/602] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:55.171452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652398-2ad0-40f1-85e4-38db0ba9e200 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:55.235337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:55.284558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81f978-6c5e-4096-b7c6-409777ea807f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:55.292936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652398-2ad0-40f1-85e4-38db0ba9e200 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:55.322501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6323fe-11bd-47f7-86db-3ee159dec81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:55.323502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6323fe-11bd-47f7-86db-3ee159dec81d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:55.323856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6323fe-11bd-47f7-86db-3ee159dec81d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:55.324201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6323fe-11bd-47f7-86db-3ee159dec81d None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:55.324954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6323fe-11bd-47f7-86db-3ee159dec81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:55.325262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6323fe-11bd-47f7-86db-3ee159dec81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:55.326665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6323fe-11bd-47f7-86db-3ee159dec81d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:55.327770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ff538-d9ea-4744-a6ec-70c53a14ef9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:55.328594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ff538-d9ea-4744-a6ec-70c53a14ef9d None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:55.328888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ff538-d9ea-4744-a6ec-70c53a14ef9d None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:55.329169 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ff538-d9ea-4744-a6ec-70c53a14ef9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:55.339277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 300/603] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:55.339424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ff538-d9ea-4744-a6ec-70c53a14ef9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:55.340464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6323fe-11bd-47f7-86db-3ee159dec81d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-169ff538-d9ea-4744-a6ec-70c53a14ef9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:55.347165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:55.348082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 304/604] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:55.349213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ff538-d9ea-4744-a6ec-70c53a14ef9d None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:55.355545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:55.452218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ff538-d9ea-4744-a6ec-70c53a14ef9d None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:55.456008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6323fe-11bd-47f7-86db-3ee159dec81d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:55.468587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:55.487630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcff48-3999-41e0-9bb5-bde6969a0873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:55.488223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcff48-3999-41e0-9bb5-bde6969a0873 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:55.488535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcff48-3999-41e0-9bb5-bde6969a0873 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:55.488816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddcff48-3999-41e0-9bb5-bde6969a0873 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:55.489605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcff48-3999-41e0-9bb5-bde6969a0873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:55.489921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcff48-3999-41e0-9bb5-bde6969a0873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:55.491418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddcff48-3999-41e0-9bb5-bde6969a0873 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:55.498173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db8b79-6563-4ec8-80c6-abe64903ca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:55.499592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db8b79-6563-4ec8-80c6-abe64903ca42 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:55.499876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db8b79-6563-4ec8-80c6-abe64903ca42 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:55.500152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db8b79-6563-4ec8-80c6-abe64903ca42 None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/e56cc5970ff645e594f50a0a204f44d1/roles/3b8809a605ba4173b9b96a4ef54212a2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:55.503458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 305/605] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:54:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:55.504241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcff48-3999-41e0-9bb5-bde6969a0873 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:55.519456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db8b79-6563-4ec8-80c6-abe64903ca42 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=e56cc5970ff645e594f50a0a204f44d1, role_id=3b8809a605ba4173b9b96a4ef54212a2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:55.520916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db8b79-6563-4ec8-80c6-abe64903ca42 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:55.541860 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 301/606] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:54:55 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/e56cc5970ff645e594f50a0a204f44d1/roles/3b8809a605ba4173b9b96a4ef54212a2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:54:55.541860 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db8b79-6563-4ec8-80c6-abe64903ca42 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:55.607030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:55.610976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddcff48-3999-41e0-9bb5-bde6969a0873 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:55.650084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ea8d-90d0-4f49-b30e-b78aa21d1aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:55.651168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ea8d-90d0-4f49-b30e-b78aa21d1aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:55.651454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ea8d-90d0-4f49-b30e-b78aa21d1aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:55.651732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ea8d-90d0-4f49-b30e-b78aa21d1aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:55.659601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0ea8d-90d0-4f49-b30e-b78aa21d1aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:55.660912 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0ea8d-90d0-4f49-b30e-b78aa21d1aa0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:55.663801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db8b79-6563-4ec8-80c6-abe64903ca42 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-24a0ea8d-90d0-4f49-b30e-b78aa21d1aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:54:55.676470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:55.677451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:55.678356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:54:55.678356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:54:55.678356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:54:55.678356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:54:55.678356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:54:55.678356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:54:55.678356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:55.678356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:55.682593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 306/607] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:55.683540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ea8d-90d0-4f49-b30e-b78aa21d1aa0 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:55.709467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c287a-35f2-4a68-ab73-a30f8f0dce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:55.711092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c287a-35f2-4a68-ab73-a30f8f0dce3c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:55.711502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c287a-35f2-4a68-ab73-a30f8f0dce3c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:55.712008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c287a-35f2-4a68-ab73-a30f8f0dce3c None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:55.713196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c287a-35f2-4a68-ab73-a30f8f0dce3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:55.713842 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c287a-35f2-4a68-ab73-a30f8f0dce3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:55.715729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c287a-35f2-4a68-ab73-a30f8f0dce3c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:55.727243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 302/608] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:55.727417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:55.727499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c287a-35f2-4a68-ab73-a30f8f0dce3c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:55.801439 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ea8d-90d0-4f49-b30e-b78aa21d1aa0 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:55.838668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9107b-bc3c-4faa-9da4-fa1e37cd0054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:55.839912 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9107b-bc3c-4faa-9da4-fa1e37cd0054 None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:55.840429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9107b-bc3c-4faa-9da4-fa1e37cd0054 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:55.840906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9107b-bc3c-4faa-9da4-fa1e37cd0054 None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/70b46194590c47c08c8d9d98904a2d98/roles/3b8809a605ba4173b9b96a4ef54212a2` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:55.856930 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9107b-bc3c-4faa-9da4-fa1e37cd0054 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=70b46194590c47c08c8d9d98904a2d98, role_id=3b8809a605ba4173b9b96a4ef54212a2)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:55.858729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9107b-bc3c-4faa-9da4-fa1e37cd0054 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:55.866768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c287a-35f2-4a68-ab73-a30f8f0dce3c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:55.883161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 307/609] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:54:55 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/70b46194590c47c08c8d9d98904a2d98/roles/3b8809a605ba4173b9b96a4ef54212a2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:54:55.883161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9107b-bc3c-4faa-9da4-fa1e37cd0054 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:55.901624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:55.939646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09bbb6-c751-4997-8e20-0a55d6b5c277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:55.940934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09bbb6-c751-4997-8e20-0a55d6b5c277 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:55.941578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09bbb6-c751-4997-8e20-0a55d6b5c277 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:55.942331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09bbb6-c751-4997-8e20-0a55d6b5c277 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:55.943594 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09bbb6-c751-4997-8e20-0a55d6b5c277 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:55.944172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09bbb6-c751-4997-8e20-0a55d6b5c277 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:55.945869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09bbb6-c751-4997-8e20-0a55d6b5c277 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:55.962854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 303/610] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:54:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:55.968363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09bbb6-c751-4997-8e20-0a55d6b5c277 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:56.043009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:56.065027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9107b-bc3c-4faa-9da4-fa1e37cd0054 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:56.118332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0048337-b4aa-4fcd-b4fe-6c99d1d14806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:56.119275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0048337-b4aa-4fcd-b4fe-6c99d1d14806 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:56.119562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0048337-b4aa-4fcd-b4fe-6c99d1d14806 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:56.119839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0048337-b4aa-4fcd-b4fe-6c99d1d14806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:56.133873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0048337-b4aa-4fcd-b4fe-6c99d1d14806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:56.135328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0048337-b4aa-4fcd-b4fe-6c99d1d14806 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-f0048337-b4aa-4fcd-b4fe-6c99d1d14806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:56.161594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:56.162540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:56.163500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:56.163500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:56.163500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:56.163500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:56.163500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 308/611] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:56.169791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0048337-b4aa-4fcd-b4fe-6c99d1d14806 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:56.175246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09bbb6-c751-4997-8e20-0a55d6b5c277 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:56.213706 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155ee51-c406-461f-b8d5-a5d4eb47e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:56.214738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155ee51-c406-461f-b8d5-a5d4eb47e476 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:56.215116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155ee51-c406-461f-b8d5-a5d4eb47e476 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:56.215489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155ee51-c406-461f-b8d5-a5d4eb47e476 None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/cbe8aea409c3459f9f7b3c3ef6ff583b/roles/3b8809a605ba4173b9b96a4ef54212a2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:56.232738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155ee51-c406-461f-b8d5-a5d4eb47e476 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=cbe8aea409c3459f9f7b3c3ef6ff583b, role_id=3b8809a605ba4173b9b96a4ef54212a2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:56.234350 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155ee51-c406-461f-b8d5-a5d4eb47e476 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:56.251682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 304/612] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:54:55 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/cbe8aea409c3459f9f7b3c3ef6ff583b/roles/3b8809a605ba4173b9b96a4ef54212a2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:54:56.253168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657c24e-9995-4280-aae0-2a3202c58424 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:56.253460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657c24e-9995-4280-aae0-2a3202c58424 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:56.253737 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657c24e-9995-4280-aae0-2a3202c58424 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:56.256380 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 305/613] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:56.261881 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0000413-952c-452e-af8d-465858c5cf30 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:56.262175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0000413-952c-452e-af8d-465858c5cf30 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:56.262443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0000413-952c-452e-af8d-465858c5cf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:56.286559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b0000413-952c-452e-af8d-465858c5cf30 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:56.289101 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b0000413-952c-452e-af8d-465858c5cf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:56.301538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0048337-b4aa-4fcd-b4fe-6c99d1d14806 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:56.325698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:56.344273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b0717-4505-414b-a207-18461971229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:56.345632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0717-4505-414b-a207-18461971229a None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:56.345632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0717-4505-414b-a207-18461971229a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:56.345632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0717-4505-414b-a207-18461971229a None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:56.346464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b0717-4505-414b-a207-18461971229a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:56.346779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b0717-4505-414b-a207-18461971229a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:56.348212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b0717-4505-414b-a207-18461971229a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:56.357238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:56.371126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 309/614] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:56.373048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b0717-4505-414b-a207-18461971229a None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:56.391179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 306/615] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:56.415314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0000413-952c-452e-af8d-465858c5cf30 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:56.486199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b0717-4505-414b-a207-18461971229a None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:56.523263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0000413-952c-452e-af8d-465858c5cf30 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:56.525194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bc9b3-b1c8-49bb-a253-6afdfdf9aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:56.526144 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bc9b3-b1c8-49bb-a253-6afdfdf9aa96 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:56.526424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bc9b3-b1c8-49bb-a253-6afdfdf9aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:56.526697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bc9b3-b1c8-49bb-a253-6afdfdf9aa96 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:56.535707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bc9b3-b1c8-49bb-a253-6afdfdf9aa96 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:56.537223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bc9b3-b1c8-49bb-a253-6afdfdf9aa96 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-d60bc9b3-b1c8-49bb-a253-6afdfdf9aa96 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:56.552539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:56.554052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:56.554977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:56.554977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:56.554977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:56.554977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:56.554977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:56.554977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:56.554977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:56.554977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:56.554977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:54:56.554977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:56.558965 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 310/616] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:54:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:56.560166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bc9b3-b1c8-49bb-a253-6afdfdf9aa96 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:56.571469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ad266-9712-438c-8206-e2e39efad8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:56.572278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad266-9712-438c-8206-e2e39efad8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:56.572591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad266-9712-438c-8206-e2e39efad8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:56.572862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad266-9712-438c-8206-e2e39efad8c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:56.588157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ad266-9712-438c-8206-e2e39efad8c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-8e7ad266-9712-438c-8206-e2e39efad8c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:56.598176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:56.599135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:56.599967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:56.604861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 307/617] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:56.605697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ad266-9712-438c-8206-e2e39efad8c7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:56.632716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:56.653609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:56.723904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bc9b3-b1c8-49bb-a253-6afdfdf9aa96 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:56.777349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ad266-9712-438c-8206-e2e39efad8c7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:56.794177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cb16f-4b6b-4940-b5e0-62c2f117a63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:56.795093 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cb16f-4b6b-4940-b5e0-62c2f117a63b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:56.795521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cb16f-4b6b-4940-b5e0-62c2f117a63b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:56.796037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cb16f-4b6b-4940-b5e0-62c2f117a63b None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:56.797269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cb16f-4b6b-4940-b5e0-62c2f117a63b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:56.797741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cb16f-4b6b-4940-b5e0-62c2f117a63b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:56.799352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cb16f-4b6b-4940-b5e0-62c2f117a63b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:56.819966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1774a0e-d8cb-4028-9392-0b219585f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:56.821678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1774a0e-d8cb-4028-9392-0b219585f9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:56.824617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1774a0e-d8cb-4028-9392-0b219585f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:56.824975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1774a0e-d8cb-4028-9392-0b219585f9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:56.825857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1774a0e-d8cb-4028-9392-0b219585f9a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:56.826534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1774a0e-d8cb-4028-9392-0b219585f9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:56.828814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1774a0e-d8cb-4028-9392-0b219585f9a2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:56.841097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 311/618] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 20 05:54:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:56.850245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cb16f-4b6b-4940-b5e0-62c2f117a63b None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:56.854326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 308/619] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:56.868479 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1774a0e-d8cb-4028-9392-0b219585f9a2 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:56.980068 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cb16f-4b6b-4940-b5e0-62c2f117a63b None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:56.997918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:57.019044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382fbbc-a4d4-4d35-bd2b-20ba006004b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:57.020102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382fbbc-a4d4-4d35-bd2b-20ba006004b7 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:57.020602 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382fbbc-a4d4-4d35-bd2b-20ba006004b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:57.021054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382fbbc-a4d4-4d35-bd2b-20ba006004b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:57.033597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382fbbc-a4d4-4d35-bd2b-20ba006004b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:57.035278 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0382fbbc-a4d4-4d35-bd2b-20ba006004b7 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:57.047816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-0382fbbc-a4d4-4d35-bd2b-20ba006004b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:57.056536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:57.057575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:57.058446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:57.058446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:57.058446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:57.058446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:57.060772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 312/620] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:57.066347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382fbbc-a4d4-4d35-bd2b-20ba006004b7 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:57.083142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1774a0e-d8cb-4028-9392-0b219585f9a2 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:57.169013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a0c1c-fa03-44ab-bb83-e82bcfb2409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:57.170067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0c1c-fa03-44ab-bb83-e82bcfb2409f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:57.170177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0c1c-fa03-44ab-bb83-e82bcfb2409f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:57.170406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0c1c-fa03-44ab-bb83-e82bcfb2409f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:57.176810 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382fbbc-a4d4-4d35-bd2b-20ba006004b7 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:57.188502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a0c1c-fa03-44ab-bb83-e82bcfb2409f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:57.189980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a0c1c-fa03-44ab-bb83-e82bcfb2409f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:57.215860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045fe56-1acc-4eae-ba1d-ed374edf2818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:57.216881 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045fe56-1acc-4eae-ba1d-ed374edf2818 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:57.217399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045fe56-1acc-4eae-ba1d-ed374edf2818 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:57.217870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045fe56-1acc-4eae-ba1d-ed374edf2818 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:57.218839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045fe56-1acc-4eae-ba1d-ed374edf2818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:57.219407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045fe56-1acc-4eae-ba1d-ed374edf2818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:57.221002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045fe56-1acc-4eae-ba1d-ed374edf2818 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e33a0c1c-fa03-44ab-bb83-e82bcfb2409f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:57.221781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:57.222693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:57.223577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:57.223577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:57.223577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:57.223577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:57.236361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 309/621] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:57.243211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 313/622] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:54:57.249392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a0c1c-fa03-44ab-bb83-e82bcfb2409f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:57.252081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045fe56-1acc-4eae-ba1d-ed374edf2818 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:57.338713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:57.362347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a0c1c-fa03-44ab-bb83-e82bcfb2409f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:57.393607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:57.405997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ad712-00f0-4a44-a496-78f7b0d2324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:57.406676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ad712-00f0-4a44-a496-78f7b0d2324e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:57.407014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ad712-00f0-4a44-a496-78f7b0d2324e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:57.407296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ad712-00f0-4a44-a496-78f7b0d2324e None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:57.408028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ad712-00f0-4a44-a496-78f7b0d2324e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:57.408360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ad712-00f0-4a44-a496-78f7b0d2324e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:57.409766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ad712-00f0-4a44-a496-78f7b0d2324e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:57.435316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 310/623] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:57.439305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ad712-00f0-4a44-a496-78f7b0d2324e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:57.472519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045fe56-1acc-4eae-ba1d-ed374edf2818 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:57.532734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f8707-194e-4b62-845f-8936e0cefe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:57.533539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f8707-194e-4b62-845f-8936e0cefe9b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:57.533823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f8707-194e-4b62-845f-8936e0cefe9b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:57.534099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f8707-194e-4b62-845f-8936e0cefe9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:57.545017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f8707-194e-4b62-845f-8936e0cefe9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:57.546479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f8707-194e-4b62-845f-8936e0cefe9b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-782f8707-194e-4b62-845f-8936e0cefe9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:54:57.570215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:57.571173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:57.572049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:54:57.572049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:54:57.572049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:54:57.572049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:54:57.572049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:54:57.572049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:54:57.572049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:57.572049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:57.572516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 314/624] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:54:57.581049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f8707-194e-4b62-845f-8936e0cefe9b None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:57.633239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ad712-00f0-4a44-a496-78f7b0d2324e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:57.691419 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc57b8-6f8a-4a8f-9eb7-40b3388e0fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:57.692146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc57b8-6f8a-4a8f-9eb7-40b3388e0fbb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:57.692480 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc57b8-6f8a-4a8f-9eb7-40b3388e0fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:57.692756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc57b8-6f8a-4a8f-9eb7-40b3388e0fbb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:57.705275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc57b8-6f8a-4a8f-9eb7-40b3388e0fbb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:57.706898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc57b8-6f8a-4a8f-9eb7-40b3388e0fbb None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-17fc57b8-6f8a-4a8f-9eb7-40b3388e0fbb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:57.732258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:57.733297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:57.734257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:57.734257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:57.734257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:57.734257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:57.734257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:57.734257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:57.734257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:57.734257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:57.734257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 05:54:57.734257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:57.734803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 311/625] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:57.742501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc57b8-6f8a-4a8f-9eb7-40b3388e0fbb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:57.756759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:57.778530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f8707-194e-4b62-845f-8936e0cefe9b None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:57.823438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b537bd-56b5-44d0-b396-6f7451c4e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:57.824103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b537bd-56b5-44d0-b396-6f7451c4e71a None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:57.824404 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b537bd-56b5-44d0-b396-6f7451c4e71a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:57.824678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b537bd-56b5-44d0-b396-6f7451c4e71a None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:57.825470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b537bd-56b5-44d0-b396-6f7451c4e71a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:57.825776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b537bd-56b5-44d0-b396-6f7451c4e71a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:57.827208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b537bd-56b5-44d0-b396-6f7451c4e71a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:57.859941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 315/626] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:54:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:57.865715 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b537bd-56b5-44d0-b396-6f7451c4e71a None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:57.903670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:57.978263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b537bd-56b5-44d0-b396-6f7451c4e71a None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:57.985438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc57b8-6f8a-4a8f-9eb7-40b3388e0fbb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:58.015259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adaf9f-9641-40d3-813b-f0afe5a92ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:58.016417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adaf9f-9641-40d3-813b-f0afe5a92ab3 None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.016950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adaf9f-9641-40d3-813b-f0afe5a92ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.017467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adaf9f-9641-40d3-813b-f0afe5a92ab3 None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/265894b988a640f0b17846d4986b670a/roles/3b8809a605ba4173b9b96a4ef54212a2` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.019664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ab63b-cffc-44b4-b726-fbb48ba864ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:58.020352 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ab63b-cffc-44b4-b726-fbb48ba864ac None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.020655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ab63b-cffc-44b4-b726-fbb48ba864ac None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.020934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ab63b-cffc-44b4-b726-fbb48ba864ac None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.022856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ab63b-cffc-44b4-b726-fbb48ba864ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:58.022856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ab63b-cffc-44b4-b726-fbb48ba864ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:58.024057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ab63b-cffc-44b4-b726-fbb48ba864ac None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:58.034581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adaf9f-9641-40d3-813b-f0afe5a92ab3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=265894b988a640f0b17846d4986b670a, role_id=3b8809a605ba4173b9b96a4ef54212a2)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:58.036193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adaf9f-9641-40d3-813b-f0afe5a92ab3 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:58.041992 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 312/627] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 20 05:54:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:58.043141 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f2fc-8f77-4bcc-a206-05a050c038ec None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.043434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f2fc-8f77-4bcc-a206-05a050c038ec None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.043749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f2fc-8f77-4bcc-a206-05a050c038ec None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.049113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 313/628] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:58.049635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:58.051505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2f676-4db1-4d1f-a59f-f9a3b94b3774 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.052212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2f676-4db1-4d1f-a59f-f9a3b94b3774 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.052707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2f676-4db1-4d1f-a59f-f9a3b94b3774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.056012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 316/629] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:54:57 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/265894b988a640f0b17846d4986b670a/roles/3b8809a605ba4173b9b96a4ef54212a2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:54:58.061378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adaf9f-9641-40d3-813b-f0afe5a92ab3 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:58.088378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7da2f676-4db1-4d1f-a59f-f9a3b94b3774 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:58.089932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7da2f676-4db1-4d1f-a59f-f9a3b94b3774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:58.236863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adaf9f-9641-40d3-813b-f0afe5a92ab3 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:58.267331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 314/630] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:54:58.286880 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c427ef-8ad6-41f5-923e-847d6b9b78c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:58.287547 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c427ef-8ad6-41f5-923e-847d6b9b78c7 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.288393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c427ef-8ad6-41f5-923e-847d6b9b78c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.288673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c427ef-8ad6-41f5-923e-847d6b9b78c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.294376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2f676-4db1-4d1f-a59f-f9a3b94b3774 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:58.342357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:58.394099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:58.396918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c427ef-8ad6-41f5-923e-847d6b9b78c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:58.399281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c427ef-8ad6-41f5-923e-847d6b9b78c7 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:58.427698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2f676-4db1-4d1f-a59f-f9a3b94b3774 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:58.466487 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb6b25-8f62-4eca-8fa4-bec659556658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:58.467292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb6b25-8f62-4eca-8fa4-bec659556658 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.467578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb6b25-8f62-4eca-8fa4-bec659556658 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.467911 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb6b25-8f62-4eca-8fa4-bec659556658 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.479983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb6b25-8f62-4eca-8fa4-bec659556658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-dbcb6b25-8f62-4eca-8fa4-bec659556658 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:58.488272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:58.489218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:58.490041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 315/631] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:58.495839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dec284-ed15-4fc3-a490-4407c8afdab3 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.495839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dec284-ed15-4fc3-a490-4407c8afdab3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.495839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dec284-ed15-4fc3-a490-4407c8afdab3 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.495839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 316/632] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:58.497183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dec284-ed15-4fc3-a490-4407c8afdab3 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:58.528621 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 317/633] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:54:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:54:58.530479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63466e13-a591-48db-8493-a10b45c1cec5 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.530968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63466e13-a591-48db-8493-a10b45c1cec5 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.531480 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63466e13-a591-48db-8493-a10b45c1cec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.549398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-63466e13-a591-48db-8493-a10b45c1cec5 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:58.551153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-63466e13-a591-48db-8493-a10b45c1cec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:58.605331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:58.620339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dec284-ed15-4fc3-a490-4407c8afdab3 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:58.622207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 318/634] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:58.623155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63466e13-a591-48db-8493-a10b45c1cec5 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:58.657272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:58.667647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbaa29-8f01-4b03-966f-e556d02607a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:58.668339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbaa29-8f01-4b03-966f-e556d02607a7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.668648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbaa29-8f01-4b03-966f-e556d02607a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.668927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbaa29-8f01-4b03-966f-e556d02607a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.669742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbaa29-8f01-4b03-966f-e556d02607a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:58.670057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbaa29-8f01-4b03-966f-e556d02607a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:58.671569 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbaa29-8f01-4b03-966f-e556d02607a7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:58.682944 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 317/635] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:58.683789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbaa29-8f01-4b03-966f-e556d02607a7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:58.735880 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63466e13-a591-48db-8493-a10b45c1cec5 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:58.774298 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4de959-3b05-40a1-ae30-72c822360fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:58.775193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de959-3b05-40a1-ae30-72c822360fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.775576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de959-3b05-40a1-ae30-72c822360fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.776212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4de959-3b05-40a1-ae30-72c822360fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.787434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4de959-3b05-40a1-ae30-72c822360fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:58.789198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4de959-3b05-40a1-ae30-72c822360fc3 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:58.792838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbaa29-8f01-4b03-966f-e556d02607a7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-1d4de959-3b05-40a1-ae30-72c822360fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:58.807581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:58.808663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:58.809760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:58.809760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:58.809760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:58.809760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:58.809760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 319/636] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:58.809760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4de959-3b05-40a1-ae30-72c822360fc3 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:58.833051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eb69f-87e0-403b-9ce8-0387be082d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:58.833843 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eb69f-87e0-403b-9ce8-0387be082d64 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.834131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eb69f-87e0-403b-9ce8-0387be082d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.834416 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eb69f-87e0-403b-9ce8-0387be082d64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.845090 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eb69f-87e0-403b-9ce8-0387be082d64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-d08eb69f-87e0-403b-9ce8-0387be082d64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:58.852950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:58.854080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:58.854955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 318/637] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:58.855646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aea8e4-eb0b-46f1-a7d3-62c5e6513fd0 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.855929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aea8e4-eb0b-46f1-a7d3-62c5e6513fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.856207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aea8e4-eb0b-46f1-a7d3-62c5e6513fd0 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.860365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 319/638] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:54:58.860365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aea8e4-eb0b-46f1-a7d3-62c5e6513fd0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:58.885239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:58.902053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:58.923074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4de959-3b05-40a1-ae30-72c822360fc3 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:58.959403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240118f-d970-4e2d-a366-a66b230cdf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:58.960257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240118f-d970-4e2d-a366-a66b230cdf66 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:58.960590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240118f-d970-4e2d-a366-a66b230cdf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:58.960870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240118f-d970-4e2d-a366-a66b230cdf66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:58.971095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240118f-d970-4e2d-a366-a66b230cdf66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:58.972595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240118f-d970-4e2d-a366-a66b230cdf66 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:58.973001 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aea8e4-eb0b-46f1-a7d3-62c5e6513fd0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-6240118f-d970-4e2d-a366-a66b230cdf66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:58.991122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:58.992047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:58.993413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:58.993413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:58.993413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:58.993413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:58.993413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 320/639] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:58.993413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240118f-d970-4e2d-a366-a66b230cdf66 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:59.016523 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a707a4-e43b-4642-9748-150748eb48a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:59.017185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a707a4-e43b-4642-9748-150748eb48a3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.017466 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a707a4-e43b-4642-9748-150748eb48a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.017742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a707a4-e43b-4642-9748-150748eb48a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.018577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a707a4-e43b-4642-9748-150748eb48a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:59.018891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a707a4-e43b-4642-9748-150748eb48a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:59.020259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a707a4-e43b-4642-9748-150748eb48a3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:59.038471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 320/640] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:59.038471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805192d8-6e42-4d98-bd89-7452e5b3e534 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.038471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805192d8-6e42-4d98-bd89-7452e5b3e534 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.038471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805192d8-6e42-4d98-bd89-7452e5b3e534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.052576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-805192d8-6e42-4d98-bd89-7452e5b3e534 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:54:59.053910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-805192d8-6e42-4d98-bd89-7452e5b3e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:54:59.098481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240118f-d970-4e2d-a366-a66b230cdf66 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:59.122558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 321/641] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:54:59.123732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805192d8-6e42-4d98-bd89-7452e5b3e534 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:59.138592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:59.144350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff038f2-4ca0-44fb-923c-531eb4953395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:59.144794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:59.146260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff038f2-4ca0-44fb-923c-531eb4953395 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.146708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff038f2-4ca0-44fb-923c-531eb4953395 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.147191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff038f2-4ca0-44fb-923c-531eb4953395 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.148089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff038f2-4ca0-44fb-923c-531eb4953395 None admin] RBAC: Adding query filter params (name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:59.148574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff038f2-4ca0-44fb-923c-531eb4953395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:59.151410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff038f2-4ca0-44fb-923c-531eb4953395 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:59.159757 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 321/642] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:59.164345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff038f2-4ca0-44fb-923c-531eb4953395 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:59.251502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805192d8-6e42-4d98-bd89-7452e5b3e534 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:59.267496 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff038f2-4ca0-44fb-923c-531eb4953395 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:59.286206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453307ab-b696-4d05-86bc-498e402589a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:59.286868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453307ab-b696-4d05-86bc-498e402589a1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.287149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453307ab-b696-4d05-86bc-498e402589a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.287421 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453307ab-b696-4d05-86bc-498e402589a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.288199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453307ab-b696-4d05-86bc-498e402589a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:59.288588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453307ab-b696-4d05-86bc-498e402589a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:59.289917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453307ab-b696-4d05-86bc-498e402589a1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:59.305887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 322/643] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:59.305887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453307ab-b696-4d05-86bc-498e402589a1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:59.307964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40aa10-ed0d-42a4-bb93-bf1cf0f36148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:59.308794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40aa10-ed0d-42a4-bb93-bf1cf0f36148 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.309084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40aa10-ed0d-42a4-bb93-bf1cf0f36148 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.309367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40aa10-ed0d-42a4-bb93-bf1cf0f36148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.316769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40aa10-ed0d-42a4-bb93-bf1cf0f36148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:59.318229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40aa10-ed0d-42a4-bb93-bf1cf0f36148 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-6f40aa10-ed0d-42a4-bb93-bf1cf0f36148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:54:59.335676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:59.336932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:59.338267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:54:59.338267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:54:59.338267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:54:59.338267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:54:59.338267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:54:59.338267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:54:59.338267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:54:59.338267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:59.338267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 322/644] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:54:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:59.338791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40aa10-ed0d-42a4-bb93-bf1cf0f36148 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:59.392006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:59.404531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:59.425711 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453307ab-b696-4d05-86bc-498e402589a1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:59.454659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40aa10-ed0d-42a4-bb93-bf1cf0f36148 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:59.461265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9d87e-ac08-450d-952d-50bee7ab50e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:59.462059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9d87e-ac08-450d-952d-50bee7ab50e3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.462346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9d87e-ac08-450d-952d-50bee7ab50e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.462631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9d87e-ac08-450d-952d-50bee7ab50e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.473793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9d87e-ac08-450d-952d-50bee7ab50e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a5c9d87e-ac08-450d-952d-50bee7ab50e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:54:59.481612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:59.482794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 323/645] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:54:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:59.483983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9d87e-ac08-450d-952d-50bee7ab50e3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:59.498298 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7908d-591a-44d3-b334-e3a118c5167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:59.499100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7908d-591a-44d3-b334-e3a118c5167e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.499374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7908d-591a-44d3-b334-e3a118c5167e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.499748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7908d-591a-44d3-b334-e3a118c5167e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.511059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7908d-591a-44d3-b334-e3a118c5167e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:59.512658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7908d-591a-44d3-b334-e3a118c5167e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-2dd7908d-591a-44d3-b334-e3a118c5167e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:54:59.532002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:59.532944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:59.533809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:54:59.533809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:54:59.533809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:54:59.533809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:54:59.533809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 323/646] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:59.534103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7908d-591a-44d3-b334-e3a118c5167e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:59.592915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9d87e-ac08-450d-952d-50bee7ab50e3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:59.622088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:59.627777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1082d-3bd4-4130-9597-388ac9c1810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:59.628596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1082d-3bd4-4130-9597-388ac9c1810c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.628888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1082d-3bd4-4130-9597-388ac9c1810c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.629170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1082d-3bd4-4130-9597-388ac9c1810c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.638331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1082d-3bd4-4130-9597-388ac9c1810c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:59.639706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7908d-591a-44d3-b334-e3a118c5167e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:59.640124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1082d-3bd4-4130-9597-388ac9c1810c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:59.647036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-68d1082d-3bd4-4130-9597-388ac9c1810c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:54:59.658536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:54:59.659504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:54:59.660499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:54:59.660499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:54:59.660499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:54:59.660499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:54:59.660499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:54:59.660499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:54:59.660499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:54:59.660499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:54:59.660499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:54:59.660499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:54:59.664447 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 324/647] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:54:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:54:59.665292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1082d-3bd4-4130-9597-388ac9c1810c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:59.679506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0fa9e-0f07-48a2-b204-3b408c1d997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:59.680452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0fa9e-0f07-48a2-b204-3b408c1d997a None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.680745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0fa9e-0f07-48a2-b204-3b408c1d997a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.681480 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0fa9e-0f07-48a2-b204-3b408c1d997a None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.682556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0fa9e-0f07-48a2-b204-3b408c1d997a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:59.682929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0fa9e-0f07-48a2-b204-3b408c1d997a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:59.685196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0fa9e-0f07-48a2-b204-3b408c1d997a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:59.707636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 324/648] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:54:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:59.707636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0fa9e-0f07-48a2-b204-3b408c1d997a None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:59.766638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1082d-3bd4-4130-9597-388ac9c1810c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:59.801164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782fdd5-f0ac-476c-be18-75659b17809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:59.801831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782fdd5-f0ac-476c-be18-75659b17809a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.802119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782fdd5-f0ac-476c-be18-75659b17809a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.802400 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782fdd5-f0ac-476c-be18-75659b17809a None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.803150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782fdd5-f0ac-476c-be18-75659b17809a None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:59.803905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782fdd5-f0ac-476c-be18-75659b17809a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:59.805327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782fdd5-f0ac-476c-be18-75659b17809a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:59.813308 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 325/649] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:54:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:59.814098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782fdd5-f0ac-476c-be18-75659b17809a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:59.820732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0fa9e-0f07-48a2-b204-3b408c1d997a None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:59.855338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f522835-4725-49c3-9c40-50fa387305bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:59.856004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f522835-4725-49c3-9c40-50fa387305bc None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.856291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f522835-4725-49c3-9c40-50fa387305bc None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.856602 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f522835-4725-49c3-9c40-50fa387305bc None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.857332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f522835-4725-49c3-9c40-50fa387305bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:59.857646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f522835-4725-49c3-9c40-50fa387305bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:59.859016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f522835-4725-49c3-9c40-50fa387305bc None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:59.871220 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 325/650] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:59.871826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f522835-4725-49c3-9c40-50fa387305bc None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:54:59.879345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:59.905707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:54:59.926336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782fdd5-f0ac-476c-be18-75659b17809a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:59.964079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8485e37-c5a2-47d7-984c-fc074206c106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:54:59.964787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485e37-c5a2-47d7-984c-fc074206c106 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:54:59.965078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485e37-c5a2-47d7-984c-fc074206c106 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:54:59.965359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8485e37-c5a2-47d7-984c-fc074206c106 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:54:59.966201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8485e37-c5a2-47d7-984c-fc074206c106 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:54:59.966514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8485e37-c5a2-47d7-984c-fc074206c106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:54:59.967946 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8485e37-c5a2-47d7-984c-fc074206c106 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:54:59.986421 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f522835-4725-49c3-9c40-50fa387305bc None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:54:59.987377 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 326/651] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jun 20 05:54:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:54:59.988210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8485e37-c5a2-47d7-984c-fc074206c106 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:00.032187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfdc4f-3c00-43c8-a880-e076f8a483d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:00.033458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfdc4f-3c00-43c8-a880-e076f8a483d9 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:00.033928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfdc4f-3c00-43c8-a880-e076f8a483d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:00.034669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfdc4f-3c00-43c8-a880-e076f8a483d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:00.035667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfdc4f-3c00-43c8-a880-e076f8a483d9 None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=80f36041751a446885608f5a3b1f37df) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:00.036142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfdc4f-3c00-43c8-a880-e076f8a483d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:00.038343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfdc4f-3c00-43c8-a880-e076f8a483d9 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:00.044605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 326/652] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:54:59 2022] GET /identity/v3/role_assignments?user.id=80f36041751a446885608f5a3b1f37df&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:00.045476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfdc4f-3c00-43c8-a880-e076f8a483d9 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:00.112301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8485e37-c5a2-47d7-984c-fc074206c106 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:00.130508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:00.157336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5d137-6019-4f0c-8737-e59c3aa93760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:00.158620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5d137-6019-4f0c-8737-e59c3aa93760 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:00.159155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5d137-6019-4f0c-8737-e59c3aa93760 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:00.159646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5d137-6019-4f0c-8737-e59c3aa93760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:00.174357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5d137-6019-4f0c-8737-e59c3aa93760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:00.175189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:00.176926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5d137-6019-4f0c-8737-e59c3aa93760 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:00.189023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfdc4f-3c00-43c8-a880-e076f8a483d9 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-b6d5d137-6019-4f0c-8737-e59c3aa93760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:00.202118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:00.203058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:00.204007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:00.204007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:00.204007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:00.204007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:00.204007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 327/653] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:00.204007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5d137-6019-4f0c-8737-e59c3aa93760 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:00.230333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2317f-c91b-4619-b504-6aea1f5af61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:00.231009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2317f-c91b-4619-b504-6aea1f5af61f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:00.231350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2317f-c91b-4619-b504-6aea1f5af61f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:00.231641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2317f-c91b-4619-b504-6aea1f5af61f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:00.250696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2317f-c91b-4619-b504-6aea1f5af61f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:00.253068 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2317f-c91b-4619-b504-6aea1f5af61f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-d2e2317f-c91b-4619-b504-6aea1f5af61f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:00.270698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:00.271676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:00.273173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:00.273173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:00.273173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:00.273173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:00.273173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:00.273173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:00.273173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:00.273173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:00.273173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 05:55:00.273173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:00.273173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 327/654] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:55:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:00.273772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2317f-c91b-4619-b504-6aea1f5af61f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:00.326845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5d137-6019-4f0c-8737-e59c3aa93760 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:00.364945 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ffb9d-62b9-47bb-acfd-2825e8f1fe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:00.366615 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ffb9d-62b9-47bb-acfd-2825e8f1fe15 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:00.367290 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ffb9d-62b9-47bb-acfd-2825e8f1fe15 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:00.367720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ffb9d-62b9-47bb-acfd-2825e8f1fe15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:00.385396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2317f-c91b-4619-b504-6aea1f5af61f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:00.402502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:00.425532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67776849-07e4-453d-a03c-35ad9fa4c4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:00.426197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67776849-07e4-453d-a03c-35ad9fa4c4ef None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:00.426484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67776849-07e4-453d-a03c-35ad9fa4c4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:00.426763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67776849-07e4-453d-a03c-35ad9fa4c4ef None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:00.427496 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67776849-07e4-453d-a03c-35ad9fa4c4ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:00.427805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67776849-07e4-453d-a03c-35ad9fa4c4ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:00.429264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67776849-07e4-453d-a03c-35ad9fa4c4ef None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:00.440785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 328/655] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:00.442097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accccd11-b957-4d84-b5b7-42365c6b38e8 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:00.442388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accccd11-b957-4d84-b5b7-42365c6b38e8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:00.442666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accccd11-b957-4d84-b5b7-42365c6b38e8 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:00.448343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 329/656] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:00.448343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accccd11-b957-4d84-b5b7-42365c6b38e8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:00.453344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ffb9d-62b9-47bb-acfd-2825e8f1fe15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:00.455019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ffb9d-62b9-47bb-acfd-2825e8f1fe15 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:00.462001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:00.555951 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accccd11-b957-4d84-b5b7-42365c6b38e8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:00.567021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 328/657] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:55:00.567021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ffb9d-62b9-47bb-acfd-2825e8f1fe15 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:00.596176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ad7ce-ae57-45a0-883f-65d7f3864e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:00.597137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad7ce-ae57-45a0-883f-65d7f3864e80 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:00.597418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad7ce-ae57-45a0-883f-65d7f3864e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:00.597703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad7ce-ae57-45a0-883f-65d7f3864e80 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:00.598534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ad7ce-ae57-45a0-883f-65d7f3864e80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:00.598853 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ad7ce-ae57-45a0-883f-65d7f3864e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:00.600838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ad7ce-ae57-45a0-883f-65d7f3864e80 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:00.623759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 330/658] 10.222.0.13 () {56 vars in 1139 bytes} [Mon Jun 20 05:55:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:00.624974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596a3fc-ad36-4407-af4e-c0871bce7412 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:00.625263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596a3fc-ad36-4407-af4e-c0871bce7412 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:00.625540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596a3fc-ad36-4407-af4e-c0871bce7412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:00.633695 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:00.642301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-2596a3fc-ad36-4407-af4e-c0871bce7412 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:00.644148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2596a3fc-ad36-4407-af4e-c0871bce7412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:00.674750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ffb9d-62b9-47bb-acfd-2825e8f1fe15 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:00.706798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:00.710242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668adbd-9b29-4eef-9ac0-acdfcff4c762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:00.711034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668adbd-9b29-4eef-9ac0-acdfcff4c762 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:00.711320 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668adbd-9b29-4eef-9ac0-acdfcff4c762 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:00.711602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668adbd-9b29-4eef-9ac0-acdfcff4c762 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:00.720346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668adbd-9b29-4eef-9ac0-acdfcff4c762 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:00.720346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668adbd-9b29-4eef-9ac0-acdfcff4c762 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:00.720900 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 331/659] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:55:00.724474 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596a3fc-ad36-4407-af4e-c0871bce7412 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c668adbd-9b29-4eef-9ac0-acdfcff4c762 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:00.738115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:00.739203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:00.740238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:00.740238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:00.740238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:00.740238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:00.740238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:00.740238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:00.740238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:00.740238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:00.740238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:00.740238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:00.740238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 329/660] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 20 05:55:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:00.741482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668adbd-9b29-4eef-9ac0-acdfcff4c762 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:00.847719 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596a3fc-ad36-4407-af4e-c0871bce7412 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:00.854218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668adbd-9b29-4eef-9ac0-acdfcff4c762 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:00.879329 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:00.884411 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725e16b-e89a-4c6a-a22b-128e0b414900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:00.885210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725e16b-e89a-4c6a-a22b-128e0b414900 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:00.885495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725e16b-e89a-4c6a-a22b-128e0b414900 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:00.885772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725e16b-e89a-4c6a-a22b-128e0b414900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:00.890615 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219121fb-4c81-4ded-9f7f-9753f228d028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:00.891261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219121fb-4c81-4ded-9f7f-9753f228d028 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:00.891542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219121fb-4c81-4ded-9f7f-9753f228d028 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:00.891814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219121fb-4c81-4ded-9f7f-9753f228d028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:00.896812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725e16b-e89a-4c6a-a22b-128e0b414900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:00.898808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725e16b-e89a-4c6a-a22b-128e0b414900 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-5725e16b-e89a-4c6a-a22b-128e0b414900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:00.917290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:00.918170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:00.919051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:00.919051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:00.919051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:00.919051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:00.919051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 332/661] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:00.919327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725e16b-e89a-4c6a-a22b-128e0b414900 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:00.967122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219121fb-4c81-4ded-9f7f-9753f228d028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:00.968624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219121fb-4c81-4ded-9f7f-9753f228d028 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:00.973071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:01.024697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725e16b-e89a-4c6a-a22b-128e0b414900 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:01.059233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810d4d2-e469-4f59-bced-89373ed1c580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:01.060024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d4d2-e469-4f59-bced-89373ed1c580 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:01.060305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d4d2-e469-4f59-bced-89373ed1c580 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:01.060601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d4d2-e469-4f59-bced-89373ed1c580 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:01.071612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810d4d2-e469-4f59-bced-89373ed1c580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:01.076883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 330/662] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:55:01.076883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219121fb-4c81-4ded-9f7f-9753f228d028 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-7810d4d2-e469-4f59-bced-89373ed1c580 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:01.079534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:01.080560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 333/663] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:55:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:01.082009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810d4d2-e469-4f59-bced-89373ed1c580 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:01.105957 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:01.187682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219121fb-4c81-4ded-9f7f-9753f228d028 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:01.189472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810d4d2-e469-4f59-bced-89373ed1c580 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:01.199454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:01.223307 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30581112-a8f7-4d62-92e8-765f2b1619ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:01.223941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30581112-a8f7-4d62-92e8-765f2b1619ac None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:01.224227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30581112-a8f7-4d62-92e8-765f2b1619ac None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:01.224458 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c26031-bfc4-4586-a8fc-874a3bd48329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:01.224576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30581112-a8f7-4d62-92e8-765f2b1619ac None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:01.225127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c26031-bfc4-4586-a8fc-874a3bd48329 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:01.225783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30581112-a8f7-4d62-92e8-765f2b1619ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:01.225984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c26031-bfc4-4586-a8fc-874a3bd48329 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:01.226093 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30581112-a8f7-4d62-92e8-765f2b1619ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:01.226242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c26031-bfc4-4586-a8fc-874a3bd48329 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:01.227061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c26031-bfc4-4586-a8fc-874a3bd48329 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:01.227354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c26031-bfc4-4586-a8fc-874a3bd48329 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:01.227449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30581112-a8f7-4d62-92e8-765f2b1619ac None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:01.228834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c26031-bfc4-4586-a8fc-874a3bd48329 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:01.246183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 334/664] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:01.247035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30581112-a8f7-4d62-92e8-765f2b1619ac None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:01.257707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 331/665] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 20 05:55:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:01.257707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c26031-bfc4-4586-a8fc-874a3bd48329 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:01.342583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:01.353709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30581112-a8f7-4d62-92e8-765f2b1619ac None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:01.363485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c26031-bfc4-4586-a8fc-874a3bd48329 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:01.387593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bb49f-c967-40ae-9ece-e39b94bfb77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:01.388414 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb49f-c967-40ae-9ece-e39b94bfb77f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:01.388702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb49f-c967-40ae-9ece-e39b94bfb77f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:01.388990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb49f-c967-40ae-9ece-e39b94bfb77f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:01.399623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bb49f-c967-40ae-9ece-e39b94bfb77f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:01.401369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bb49f-c967-40ae-9ece-e39b94bfb77f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:01.401567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79a377-4004-4a53-a03b-99a1393faaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:01.402466 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79a377-4004-4a53-a03b-99a1393faaa4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:01.402757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79a377-4004-4a53-a03b-99a1393faaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:01.403125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79a377-4004-4a53-a03b-99a1393faaa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:01.404158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79a377-4004-4a53-a03b-99a1393faaa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:01.404751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79a377-4004-4a53-a03b-99a1393faaa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:01.406336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79a377-4004-4a53-a03b-99a1393faaa4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:01.418831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 332/666] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:55:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:01.418831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79a377-4004-4a53-a03b-99a1393faaa4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-590bb49f-c967-40ae-9ece-e39b94bfb77f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:01.419084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:01.419996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:01.420938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:01.420938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:01.420938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:01.420938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:01.420938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 335/667] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:01.421222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bb49f-c967-40ae-9ece-e39b94bfb77f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:01.450775 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:01.531589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bb49f-c967-40ae-9ece-e39b94bfb77f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:01.537262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79a377-4004-4a53-a03b-99a1393faaa4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:01.566290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af681-8483-48db-93b4-2b7d5258215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:01.566937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af681-8483-48db-93b4-2b7d5258215e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:01.567222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af681-8483-48db-93b4-2b7d5258215e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:01.567499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af681-8483-48db-93b4-2b7d5258215e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:01.571149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c55212-4a29-4863-a93a-02f394bea5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:01.571996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55212-4a29-4863-a93a-02f394bea5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:01.572284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55212-4a29-4863-a93a-02f394bea5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:01.572586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c55212-4a29-4863-a93a-02f394bea5a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:01.579295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c55212-4a29-4863-a93a-02f394bea5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:01.580786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c55212-4a29-4863-a93a-02f394bea5a5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-70c55212-4a29-4863-a93a-02f394bea5a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:01.594939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:01.595828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:01.597169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:01.597169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:01.597169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:01.597169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:01.597169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:01.597169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:01.597169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:01.597169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:01.597169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 333/668] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:01.597169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c55212-4a29-4863-a93a-02f394bea5a5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:01.600867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:01.642866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09af681-8483-48db-93b4-2b7d5258215e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:01.644642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09af681-8483-48db-93b4-2b7d5258215e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:01.667524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:01.708089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c55212-4a29-4863-a93a-02f394bea5a5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:01.743775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ca766-de0f-4631-b604-800863bdbe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:01.744602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ca766-de0f-4631-b604-800863bdbe55 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:01.744911 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ca766-de0f-4631-b604-800863bdbe55 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:01.745190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ca766-de0f-4631-b604-800863bdbe55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:01.751821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 336/669] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:55:01.753037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af681-8483-48db-93b4-2b7d5258215e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:01.759156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ca766-de0f-4631-b604-800863bdbe55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:01.760657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ca766-de0f-4631-b604-800863bdbe55 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-3a8ca766-de0f-4631-b604-800863bdbe55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:01.779956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:01.781029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:01.782216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:01.782216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:01.782216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:01.782216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:01.785770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 334/670] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:01.786613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ca766-de0f-4631-b604-800863bdbe55 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:01.845788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:01.867591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af681-8483-48db-93b4-2b7d5258215e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:01.891582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:01.895155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ca766-de0f-4631-b604-800863bdbe55 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:01.904126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184735d7-f17b-4051-8654-17c7f0eb192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:01.904904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184735d7-f17b-4051-8654-17c7f0eb192f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:01.905195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184735d7-f17b-4051-8654-17c7f0eb192f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:01.905489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184735d7-f17b-4051-8654-17c7f0eb192f None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:01.906223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184735d7-f17b-4051-8654-17c7f0eb192f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:01.906539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184735d7-f17b-4051-8654-17c7f0eb192f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:01.907924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184735d7-f17b-4051-8654-17c7f0eb192f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:01.919969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 337/671] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:01.920858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184735d7-f17b-4051-8654-17c7f0eb192f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:01.935227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9f3d9-3587-410e-8c93-28996e9efdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:01.936096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9f3d9-3587-410e-8c93-28996e9efdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:01.936667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9f3d9-3587-410e-8c93-28996e9efdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:01.936949 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9f3d9-3587-410e-8c93-28996e9efdc1 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:01.937742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9f3d9-3587-410e-8c93-28996e9efdc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:01.938056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9f3d9-3587-410e-8c93-28996e9efdc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:01.939492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9f3d9-3587-410e-8c93-28996e9efdc1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:01.951453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 335/672] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:01.952121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9f3d9-3587-410e-8c93-28996e9efdc1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:02.037553 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184735d7-f17b-4051-8654-17c7f0eb192f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:02.060181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9f3d9-3587-410e-8c93-28996e9efdc1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:02.072443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931287a-754a-4313-8c9b-6b149320f728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:02.073337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931287a-754a-4313-8c9b-6b149320f728 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.073628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931287a-754a-4313-8c9b-6b149320f728 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.073908 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931287a-754a-4313-8c9b-6b149320f728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.077797 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:02.085024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931287a-754a-4313-8c9b-6b149320f728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:02.086501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931287a-754a-4313-8c9b-6b149320f728 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:02.097264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273e0cb-16d3-4696-af4f-bc9901ac4436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:02.097920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273e0cb-16d3-4696-af4f-bc9901ac4436 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.098198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273e0cb-16d3-4696-af4f-bc9901ac4436 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.098472 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273e0cb-16d3-4696-af4f-bc9901ac4436 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.099184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273e0cb-16d3-4696-af4f-bc9901ac4436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:02.099490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273e0cb-16d3-4696-af4f-bc9901ac4436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:02.101396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273e0cb-16d3-4696-af4f-bc9901ac4436 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-c931287a-754a-4313-8c9b-6b149320f728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:02.104382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:02.105254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:02.106147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:02.106147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:02.106147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:02.106147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:02.106147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 338/673] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:02.106878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931287a-754a-4313-8c9b-6b149320f728 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:02.118178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 336/674] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:02.119022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273e0cb-16d3-4696-af4f-bc9901ac4436 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:02.147201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:02.219539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931287a-754a-4313-8c9b-6b149320f728 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:02.226549 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273e0cb-16d3-4696-af4f-bc9901ac4436 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:02.256110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970aec5-076c-4592-b690-b43db872dacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:02.256948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970aec5-076c-4592-b690-b43db872dacd None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.257236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970aec5-076c-4592-b690-b43db872dacd None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.257521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970aec5-076c-4592-b690-b43db872dacd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.260196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621e6a-fd39-4064-8f2d-fe1c5b0ac4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:02.260862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621e6a-fd39-4064-8f2d-fe1c5b0ac4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.261149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621e6a-fd39-4064-8f2d-fe1c5b0ac4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.261430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621e6a-fd39-4064-8f2d-fe1c5b0ac4c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.262258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a621e6a-fd39-4064-8f2d-fe1c5b0ac4c8 None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=e56cc5970ff645e594f50a0a204f44d1) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:02.262575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a621e6a-fd39-4064-8f2d-fe1c5b0ac4c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:02.264006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a621e6a-fd39-4064-8f2d-fe1c5b0ac4c8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:02.264146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970aec5-076c-4592-b690-b43db872dacd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:02.265604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970aec5-076c-4592-b690-b43db872dacd None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:02.270030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 337/675] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:02 2022] GET /identity/v3/role_assignments?user.id=e56cc5970ff645e594f50a0a204f44d1&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:02.270707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621e6a-fd39-4064-8f2d-fe1c5b0ac4c8 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-4970aec5-076c-4592-b690-b43db872dacd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:02.280804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:02.281772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:02.287422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:02.287422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:02.287422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:02.287422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:02.287422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:02.287422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:02.287422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:02.287422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:02.287422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 339/676] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:02.287422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970aec5-076c-4592-b690-b43db872dacd None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:02.328177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:02.393581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:02.394605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621e6a-fd39-4064-8f2d-fe1c5b0ac4c8 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:02.402912 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970aec5-076c-4592-b690-b43db872dacd None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:02.437000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72ee0e-8ee6-4629-ac2a-ba38059df5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:02.437658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72ee0e-8ee6-4629-ac2a-ba38059df5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.437938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72ee0e-8ee6-4629-ac2a-ba38059df5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.438210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72ee0e-8ee6-4629-ac2a-ba38059df5b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.438932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72ee0e-8ee6-4629-ac2a-ba38059df5b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:02.439242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72ee0e-8ee6-4629-ac2a-ba38059df5b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:02.440688 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de72ee0e-8ee6-4629-ac2a-ba38059df5b2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:02.445683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29e590-7a67-4a9c-b227-6fc44cee6aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:02.446489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29e590-7a67-4a9c-b227-6fc44cee6aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.446779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29e590-7a67-4a9c-b227-6fc44cee6aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.447057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29e590-7a67-4a9c-b227-6fc44cee6aa7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.454710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 338/677] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:02.456075 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68258ebb-1886-4abc-89a6-1bb5389d95d3 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.456405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68258ebb-1886-4abc-89a6-1bb5389d95d3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.456680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68258ebb-1886-4abc-89a6-1bb5389d95d3 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.458044 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 339/678] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:02.458726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68258ebb-1886-4abc-89a6-1bb5389d95d3 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:02.459720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29e590-7a67-4a9c-b227-6fc44cee6aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:02.461566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29e590-7a67-4a9c-b227-6fc44cee6aa7 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-eb29e590-7a67-4a9c-b227-6fc44cee6aa7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:02.478096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:02.479208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 340/679] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:02.480158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29e590-7a67-4a9c-b227-6fc44cee6aa7 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:02.575597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:02.580094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68258ebb-1886-4abc-89a6-1bb5389d95d3 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:02.590415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29e590-7a67-4a9c-b227-6fc44cee6aa7 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:02.614877 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97114042-9845-4bee-b15b-88058fe87080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:02.615541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114042-9845-4bee-b15b-88058fe87080 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.616359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114042-9845-4bee-b15b-88058fe87080 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.616641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97114042-9845-4bee-b15b-88058fe87080 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.617431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97114042-9845-4bee-b15b-88058fe87080 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:02.617743 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97114042-9845-4bee-b15b-88058fe87080 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:02.619221 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97114042-9845-4bee-b15b-88058fe87080 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:02.625452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bafea-2c7c-4979-8cd6-d0583b4a5eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:02.626242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bafea-2c7c-4979-8cd6-d0583b4a5eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.626531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bafea-2c7c-4979-8cd6-d0583b4a5eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.626799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bafea-2c7c-4979-8cd6-d0583b4a5eb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.632873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 340/680] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:02.634202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bafea-2c7c-4979-8cd6-d0583b4a5eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:02.634796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a85f5-a686-4e16-b584-5a98bec808c1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.635251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a85f5-a686-4e16-b584-5a98bec808c1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.635648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bafea-2c7c-4979-8cd6-d0583b4a5eb0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:02.635883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a85f5-a686-4e16-b584-5a98bec808c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-d34bafea-2c7c-4979-8cd6-d0583b4a5eb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:02.651745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:02.652963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:02.653946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:02.653946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:02.653946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:02.653946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:02.653946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:02.653946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:02.653946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:02.653946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:02.655365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c40a85f5-a686-4e16-b584-5a98bec808c1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:02.656595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c40a85f5-a686-4e16-b584-5a98bec808c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:02.657660 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 341/681] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:02.658489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bafea-2c7c-4979-8cd6-d0583b4a5eb0 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:02.674689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:02.736666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 341/682] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:55:02.737583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a85f5-a686-4e16-b584-5a98bec808c1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:02.767611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bafea-2c7c-4979-8cd6-d0583b4a5eb0 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:02.805562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60c2b-4b84-4928-b753-2ca48e562dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:02.806622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60c2b-4b84-4928-b753-2ca48e562dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.807161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60c2b-4b84-4928-b753-2ca48e562dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.807710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be60c2b-4b84-4928-b753-2ca48e562dd1 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.808937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be60c2b-4b84-4928-b753-2ca48e562dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:02.809418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be60c2b-4b84-4928-b753-2ca48e562dd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:02.811012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be60c2b-4b84-4928-b753-2ca48e562dd1 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:02.833657 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 342/683] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 20 05:55:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:02.835349 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60c2b-4b84-4928-b753-2ca48e562dd1 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:02.847006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:02.856759 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a85f5-a686-4e16-b584-5a98bec808c1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:02.891767 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffe98d-440a-438c-9938-04baadd03232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:02.892451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffe98d-440a-438c-9938-04baadd03232 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:02.892739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffe98d-440a-438c-9938-04baadd03232 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:02.893019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffe98d-440a-438c-9938-04baadd03232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:02.893845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffe98d-440a-438c-9938-04baadd03232 None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=70b46194590c47c08c8d9d98904a2d98) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:02.894161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffe98d-440a-438c-9938-04baadd03232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:02.895600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffe98d-440a-438c-9938-04baadd03232 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:02.901621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 342/684] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:02 2022] GET /identity/v3/role_assignments?user.id=70b46194590c47c08c8d9d98904a2d98&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:02.902380 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffe98d-440a-438c-9938-04baadd03232 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:02.924911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:02.966053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be60c2b-4b84-4928-b753-2ca48e562dd1 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:03.019253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f8e12-6824-47ca-a892-b92abf6956b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:03.020537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f8e12-6824-47ca-a892-b92abf6956b3 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:03.020849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f8e12-6824-47ca-a892-b92abf6956b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:03.021132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f8e12-6824-47ca-a892-b92abf6956b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:03.022487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f8e12-6824-47ca-a892-b92abf6956b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:03.022815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f8e12-6824-47ca-a892-b92abf6956b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:03.024300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f8e12-6824-47ca-a892-b92abf6956b3 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:03.039958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffe98d-440a-438c-9938-04baadd03232 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:03.044559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 343/685] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:03.045811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f8e12-6824-47ca-a892-b92abf6956b3 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:03.091622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bc68c-d494-4b4d-8203-e69eb993bdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:03.092399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bc68c-d494-4b4d-8203-e69eb993bdc4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:03.092636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bc68c-d494-4b4d-8203-e69eb993bdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:03.092908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bc68c-d494-4b4d-8203-e69eb993bdc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:03.103846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bc68c-d494-4b4d-8203-e69eb993bdc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:03.105325 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bc68c-d494-4b4d-8203-e69eb993bdc4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4e5bc68c-d494-4b4d-8203-e69eb993bdc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:03.126678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:03.127622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:03.128596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:03.128596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:03.128596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:03.128596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:03.132811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 343/686] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:03.132811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bc68c-d494-4b4d-8203-e69eb993bdc4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:03.144650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:03.167489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f8e12-6824-47ca-a892-b92abf6956b3 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:03.198695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:03.204742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192590b-6ef0-40d8-abb0-b9522f724c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:03.205393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192590b-6ef0-40d8-abb0-b9522f724c92 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:03.205684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192590b-6ef0-40d8-abb0-b9522f724c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:03.205965 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192590b-6ef0-40d8-abb0-b9522f724c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:03.261267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bc68c-d494-4b4d-8203-e69eb993bdc4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:03.286912 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192590b-6ef0-40d8-abb0-b9522f724c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:03.289194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192590b-6ef0-40d8-abb0-b9522f724c92 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:03.299474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7026a-7edf-492a-8162-c12cb38b29ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:03.300489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7026a-7edf-492a-8162-c12cb38b29ce None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:03.300937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7026a-7edf-492a-8162-c12cb38b29ce None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:03.301382 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7026a-7edf-492a-8162-c12cb38b29ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:03.302409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7026a-7edf-492a-8162-c12cb38b29ce None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=cbe8aea409c3459f9f7b3c3ef6ff583b) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:03.302907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7026a-7edf-492a-8162-c12cb38b29ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:03.304744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7026a-7edf-492a-8162-c12cb38b29ce None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:03.311910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 344/687] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:03 2022] GET /identity/v3/role_assignments?user.id=cbe8aea409c3459f9f7b3c3ef6ff583b&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:03.312933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7026a-7edf-492a-8162-c12cb38b29ce None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:03.495365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:03.537486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 344/688] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:55:03.542896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7026a-7edf-492a-8162-c12cb38b29ce None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:03.552337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192590b-6ef0-40d8-abb0-b9522f724c92 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:03.608705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:03.614027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55469ede-91e1-4efd-8d06-ee6417b3a68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:03.614699 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55469ede-91e1-4efd-8d06-ee6417b3a68f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:03.614980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55469ede-91e1-4efd-8d06-ee6417b3a68f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:03.615252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55469ede-91e1-4efd-8d06-ee6417b3a68f None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:03.617702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55469ede-91e1-4efd-8d06-ee6417b3a68f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:03.617839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55469ede-91e1-4efd-8d06-ee6417b3a68f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:03.619152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55469ede-91e1-4efd-8d06-ee6417b3a68f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:03.635529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 345/689] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:03.641842 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55469ede-91e1-4efd-8d06-ee6417b3a68f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:03.699689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192590b-6ef0-40d8-abb0-b9522f724c92 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:03.741949 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2807d5b-6b47-456d-8517-ec6b864bb883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:03.743689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2807d5b-6b47-456d-8517-ec6b864bb883 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:03.744221 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2807d5b-6b47-456d-8517-ec6b864bb883 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:03.744758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2807d5b-6b47-456d-8517-ec6b864bb883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:03.756100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55469ede-91e1-4efd-8d06-ee6417b3a68f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:03.758286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2807d5b-6b47-456d-8517-ec6b864bb883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:03.760190 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2807d5b-6b47-456d-8517-ec6b864bb883 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-f2807d5b-6b47-456d-8517-ec6b864bb883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:03.783814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:03.784799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:03.785682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:03.785682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:03.785682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:03.785682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:03.788056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 345/690] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:03.792036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2807d5b-6b47-456d-8517-ec6b864bb883 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:03.813743 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:03.828363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6bc7d-d87c-4970-a625-48fe0500d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:03.828363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6bc7d-d87c-4970-a625-48fe0500d838 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:03.828363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6bc7d-d87c-4970-a625-48fe0500d838 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:03.828363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6bc7d-d87c-4970-a625-48fe0500d838 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:03.828806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6bc7d-d87c-4970-a625-48fe0500d838 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:03.828806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6bc7d-d87c-4970-a625-48fe0500d838 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:03.880283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 346/691] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:55:03 2022] POST /identity/v3/users => generated 254 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:55:03.920702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:03.936572 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2807d5b-6b47-456d-8517-ec6b864bb883 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:04.001662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474c97a-8044-44b7-b28b-4ee8a3d308ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:04.002355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474c97a-8044-44b7-b28b-4ee8a3d308ec None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:04.002643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474c97a-8044-44b7-b28b-4ee8a3d308ec None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:04.002923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474c97a-8044-44b7-b28b-4ee8a3d308ec None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:04.003677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474c97a-8044-44b7-b28b-4ee8a3d308ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:04.003989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474c97a-8044-44b7-b28b-4ee8a3d308ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:04.005513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2474c97a-8044-44b7-b28b-4ee8a3d308ec None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:04.027309 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 346/692] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:04.032873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6bc7d-d87c-4970-a625-48fe0500d838 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:04.176045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6bc7d-d87c-4970-a625-48fe0500d838 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:04.212846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb975ac-8782-459a-b553-7a3371015a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:04.213651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb975ac-8782-459a-b553-7a3371015a78 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:04.213928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb975ac-8782-459a-b553-7a3371015a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:04.214209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb975ac-8782-459a-b553-7a3371015a78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:04.221442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb975ac-8782-459a-b553-7a3371015a78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:04.222893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb975ac-8782-459a-b553-7a3371015a78 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-3fb975ac-8782-459a-b553-7a3371015a78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:04.238021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:04.238891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:04.239786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:04.239786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:04.239786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:04.239786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:04.239786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:04.239786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:04.239786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:04.239786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:04.239786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 347/693] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:04.247454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474c97a-8044-44b7-b28b-4ee8a3d308ec None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:04.363173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2474c97a-8044-44b7-b28b-4ee8a3d308ec None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:04.406985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23774ba7-ceef-4811-a995-cc4d467b3625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:04.407660 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23774ba7-ceef-4811-a995-cc4d467b3625 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:04.407947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23774ba7-ceef-4811-a995-cc4d467b3625 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:04.408228 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23774ba7-ceef-4811-a995-cc4d467b3625 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:04.409057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23774ba7-ceef-4811-a995-cc4d467b3625 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:04.409370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23774ba7-ceef-4811-a995-cc4d467b3625 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:04.410819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23774ba7-ceef-4811-a995-cc4d467b3625 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:04.424547 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 347/694] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:04.430235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb975ac-8782-459a-b553-7a3371015a78 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:04.502521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:04.581525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb975ac-8782-459a-b553-7a3371015a78 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:04.600538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0552e2-dc3e-42cb-9b68-76d95562e7c6 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:04.601235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0552e2-dc3e-42cb-9b68-76d95562e7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:04.601527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0552e2-dc3e-42cb-9b68-76d95562e7c6 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:04.603787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 348/695] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:04.608802 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869984f-17ee-4041-9a23-7438c0066a32 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:04.609316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869984f-17ee-4041-9a23-7438c0066a32 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:04.609822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869984f-17ee-4041-9a23-7438c0066a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:04.626976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:04.631028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d1530-5581-4f1d-a77e-78a262e9dec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:04.633149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d1530-5581-4f1d-a77e-78a262e9dec0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:04.633581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d1530-5581-4f1d-a77e-78a262e9dec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:04.633999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d1530-5581-4f1d-a77e-78a262e9dec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:04.634992 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d1530-5581-4f1d-a77e-78a262e9dec0 None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=265894b988a640f0b17846d4986b670a) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:04.635446 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d1530-5581-4f1d-a77e-78a262e9dec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:04.637510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d1530-5581-4f1d-a77e-78a262e9dec0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:04.648509 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 348/696] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:04 2022] GET /identity/v3/role_assignments?user.id=265894b988a640f0b17846d4986b670a&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:04.649748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-2869984f-17ee-4041-9a23-7438c0066a32 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:04.651369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2869984f-17ee-4041-9a23-7438c0066a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:04.762853 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 349/697] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:55:04.797977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d1530-5581-4f1d-a77e-78a262e9dec0 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:04.909840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d1530-5581-4f1d-a77e-78a262e9dec0 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:04.920991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:04.950902 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3d73-4af4-4285-bb9a-5a9149a33028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:04.951720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3d73-4af4-4285-bb9a-5a9149a33028 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:04.951998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3d73-4af4-4285-bb9a-5a9149a33028 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:04.952269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca3d73-4af4-4285-bb9a-5a9149a33028 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:04.952960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca3d73-4af4-4285-bb9a-5a9149a33028 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:04.954322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca3d73-4af4-4285-bb9a-5a9149a33028 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-54ca3d73-4af4-4285-bb9a-5a9149a33028 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:04.970760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:04.971793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:55:04.973127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:04.976432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 349/698] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jun 20 05:55:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:04.979157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869984f-17ee-4041-9a23-7438c0066a32 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:05.087039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869984f-17ee-4041-9a23-7438c0066a32 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:05.126169 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edd3e2-f5e4-4c9a-bb80-1d2c637139f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:05.126837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edd3e2-f5e4-4c9a-bb80-1d2c637139f2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:05.127117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edd3e2-f5e4-4c9a-bb80-1d2c637139f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:05.127393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edd3e2-f5e4-4c9a-bb80-1d2c637139f2 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:05.128107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edd3e2-f5e4-4c9a-bb80-1d2c637139f2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:05.128441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edd3e2-f5e4-4c9a-bb80-1d2c637139f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:05.129805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edd3e2-f5e4-4c9a-bb80-1d2c637139f2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:05.131007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:05.135333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 350/699] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 20 05:55:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:05.141054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3d73-4af4-4285-bb9a-5a9149a33028 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:05.244563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca3d73-4af4-4285-bb9a-5a9149a33028 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:05.278796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88b55c-7d6e-4cfa-82ed-ed3e3793122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:05.279454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b55c-7d6e-4cfa-82ed-ed3e3793122b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:05.279735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b55c-7d6e-4cfa-82ed-ed3e3793122b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:05.280009 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b55c-7d6e-4cfa-82ed-ed3e3793122b None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:05.280740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88b55c-7d6e-4cfa-82ed-ed3e3793122b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:05.281046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88b55c-7d6e-4cfa-82ed-ed3e3793122b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:05.282492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88b55c-7d6e-4cfa-82ed-ed3e3793122b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:05.288657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 350/700] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 20 05:55:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:05.445476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde76435-bc7c-464d-8aac-8c335c0f9f2a None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:05.445795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde76435-bc7c-464d-8aac-8c335c0f9f2a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:05.446049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde76435-bc7c-464d-8aac-8c335c0f9f2a None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:05.447571 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 351/701] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:05.452694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f182bc-ab64-4d22-9ee5-4142cc78053f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:05.452987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f182bc-ab64-4d22-9ee5-4142cc78053f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:05.453267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f182bc-ab64-4d22-9ee5-4142cc78053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:05.471295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-37f182bc-ab64-4d22-9ee5-4142cc78053f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:05.472528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-37f182bc-ab64-4d22-9ee5-4142cc78053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:05.505315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:05.548242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 351/702] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:55:05.571662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde76435-bc7c-464d-8aac-8c335c0f9f2a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:05.696549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde76435-bc7c-464d-8aac-8c335c0f9f2a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:05.739423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d125a6f-d2f2-40e2-8c4f-2324b2a7f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:05.740275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d125a6f-d2f2-40e2-8c4f-2324b2a7f84c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:05.740615 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d125a6f-d2f2-40e2-8c4f-2324b2a7f84c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:05.740932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d125a6f-d2f2-40e2-8c4f-2324b2a7f84c None admin] PATH_INFO: `/v3/services/network` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:05.741638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d125a6f-d2f2-40e2-8c4f-2324b2a7f84c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:05.743016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d125a6f-d2f2-40e2-8c4f-2324b2a7f84c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-2d125a6f-d2f2-40e2-8c4f-2324b2a7f84c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:05.763052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:05.764075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:55:05.764932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:05.768771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 352/703] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:05 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:05.770710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f182bc-ab64-4d22-9ee5-4142cc78053f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:05.891988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f182bc-ab64-4d22-9ee5-4142cc78053f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:05.944920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0d873-b907-4ad4-9ec6-a0d67a8296c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:05.945591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0d873-b907-4ad4-9ec6-a0d67a8296c7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:05.945876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0d873-b907-4ad4-9ec6-a0d67a8296c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:05.946154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0d873-b907-4ad4-9ec6-a0d67a8296c7 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:05.946871 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0d873-b907-4ad4-9ec6-a0d67a8296c7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:05.947179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0d873-b907-4ad4-9ec6-a0d67a8296c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:05.948596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0d873-b907-4ad4-9ec6-a0d67a8296c7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:05.956389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 352/704] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:05.962007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d125a6f-d2f2-40e2-8c4f-2324b2a7f84c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:06.062681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:06.112551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526c0d-6b08-4cca-bff4-754bf6abe35a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:06.112841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526c0d-6b08-4cca-bff4-754bf6abe35a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:06.113126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526c0d-6b08-4cca-bff4-754bf6abe35a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:06.114494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 353/705] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:06.121590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d125a6f-d2f2-40e2-8c4f-2324b2a7f84c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:06.121764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189b359-8fe3-48ea-bb0d-1db4d856505c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:06.121940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189b359-8fe3-48ea-bb0d-1db4d856505c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:06.122191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189b359-8fe3-48ea-bb0d-1db4d856505c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:06.154258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9189b359-8fe3-48ea-bb0d-1db4d856505c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:06.155378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9189b359-8fe3-48ea-bb0d-1db4d856505c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:06.165970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50f02b-45af-4122-83f8-fb88f8598560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:06.166940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50f02b-45af-4122-83f8-fb88f8598560 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:06.167439 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50f02b-45af-4122-83f8-fb88f8598560 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:06.167922 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50f02b-45af-4122-83f8-fb88f8598560 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:06.168866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50f02b-45af-4122-83f8-fb88f8598560 None admin] RBAC: Adding query filter params (type=network) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:06.171663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50f02b-45af-4122-83f8-fb88f8598560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:06.173341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50f02b-45af-4122-83f8-fb88f8598560 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:06.183612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 353/706] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:06.212642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:06.266156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 354/707] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:55:06.305306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50f02b-45af-4122-83f8-fb88f8598560 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:06.441302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50f02b-45af-4122-83f8-fb88f8598560 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:06.478565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:06.493015 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0342f-8647-4707-b586-140c5bec0351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:06.493818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0342f-8647-4707-b586-140c5bec0351 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:06.494107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0342f-8647-4707-b586-140c5bec0351 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:06.494386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0342f-8647-4707-b586-140c5bec0351 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:06.511204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0342f-8647-4707-b586-140c5bec0351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-e0d0342f-8647-4707-b586-140c5bec0351 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:06.518910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:06.519819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:06.520677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 354/708] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:06.526227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189b359-8fe3-48ea-bb0d-1db4d856505c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:06.724190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189b359-8fe3-48ea-bb0d-1db4d856505c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:06.766302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe51721-e5ef-44d7-9094-e4620285ac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:06.766969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe51721-e5ef-44d7-9094-e4620285ac6f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:06.767254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe51721-e5ef-44d7-9094-e4620285ac6f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:06.767526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe51721-e5ef-44d7-9094-e4620285ac6f None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:06.768269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe51721-e5ef-44d7-9094-e4620285ac6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:06.768606 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe51721-e5ef-44d7-9094-e4620285ac6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:06.769984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe51721-e5ef-44d7-9094-e4620285ac6f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:06.779148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 355/709] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:55:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:06.785380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0342f-8647-4707-b586-140c5bec0351 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:06.838899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4841b-d0e8-40b9-811c-09c212bc5399 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:06.839498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4841b-d0e8-40b9-811c-09c212bc5399 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:06.839783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4841b-d0e8-40b9-811c-09c212bc5399 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:06.841304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 356/710] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:06.846286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2e60d-6a2b-41c0-8887-ee3b510103de None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:06.846740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2e60d-6a2b-41c0-8887-ee3b510103de None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:06.847021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2e60d-6a2b-41c0-8887-ee3b510103de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:06.866658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-06f2e60d-6a2b-41c0-8887-ee3b510103de None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:06.868002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-06f2e60d-6a2b-41c0-8887-ee3b510103de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:06.895409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:06.969204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0342f-8647-4707-b586-140c5bec0351 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:06.997614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 357/711] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 05:55:07.029472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf1bc0-e8c8-4e82-8ec3-74e9d4a2dd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:07.030598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf1bc0-e8c8-4e82-8ec3-74e9d4a2dd8b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:07.030895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf1bc0-e8c8-4e82-8ec3-74e9d4a2dd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:07.031176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf1bc0-e8c8-4e82-8ec3-74e9d4a2dd8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:07.047607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf1bc0-e8c8-4e82-8ec3-74e9d4a2dd8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:07.049111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf1bc0-e8c8-4e82-8ec3-74e9d4a2dd8b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:07.064432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2e60d-6a2b-41c0-8887-ee3b510103de None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-3acf1bc0-e8c8-4e82-8ec3-74e9d4a2dd8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:07.078200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:07.079116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:07.080009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:07.080009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:07.080009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:07.080009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:07.081583 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 355/712] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:07.087796 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf1bc0-e8c8-4e82-8ec3-74e9d4a2dd8b None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:07.185196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:07.211142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2e60d-6a2b-41c0-8887-ee3b510103de None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:07.255348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf1bc0-e8c8-4e82-8ec3-74e9d4a2dd8b None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:07.290246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a8ff-f21a-41a5-9016-e6f469275b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:07.291571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a8ff-f21a-41a5-9016-e6f469275b5b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:07.292107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7faecb-2740-4a8d-a016-00b61b2a1dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:07.292298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a8ff-f21a-41a5-9016-e6f469275b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:07.292414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a8ff-f21a-41a5-9016-e6f469275b5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:07.293186 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7faecb-2740-4a8d-a016-00b61b2a1dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:07.293639 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7faecb-2740-4a8d-a016-00b61b2a1dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:07.294179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7faecb-2740-4a8d-a016-00b61b2a1dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:07.295071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7faecb-2740-4a8d-a016-00b61b2a1dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:07.295527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7faecb-2740-4a8d-a016-00b61b2a1dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:07.297077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7faecb-2740-4a8d-a016-00b61b2a1dc9 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:07.310209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 356/713] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:07.316431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7faecb-2740-4a8d-a016-00b61b2a1dc9 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:07.318096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964a8ff-f21a-41a5-9016-e6f469275b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-1964a8ff-f21a-41a5-9016-e6f469275b5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:07.334917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:07.336165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:55:07.337266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:07.342938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 358/714] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:55:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:07.348992 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a8ff-f21a-41a5-9016-e6f469275b5b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:07.383439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:07.469723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:07.474547 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7faecb-2740-4a8d-a016-00b61b2a1dc9 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:07.514997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706bf09-5a3e-4f69-ad94-479853c71da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:07.516126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706bf09-5a3e-4f69-ad94-479853c71da2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:07.516612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706bf09-5a3e-4f69-ad94-479853c71da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:07.517041 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706bf09-5a3e-4f69-ad94-479853c71da2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:07.525198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706bf09-5a3e-4f69-ad94-479853c71da2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:07.527276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706bf09-5a3e-4f69-ad94-479853c71da2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-9706bf09-5a3e-4f69-ad94-479853c71da2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:07.554981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:07.556264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:07.557369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:07.557369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:07.557369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:07.557369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:07.557369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:07.557369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:07.557369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:07.557369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:07.557369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:07.557369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:07.561764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 357/715] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 20 05:55:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:07.564157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a8ff-f21a-41a5-9016-e6f469275b5b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:07.567541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706bf09-5a3e-4f69-ad94-479853c71da2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:07.635735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a09e67-3874-44fa-9bc6-eee9a4464666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:07.636726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a09e67-3874-44fa-9bc6-eee9a4464666 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:07.638024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a09e67-3874-44fa-9bc6-eee9a4464666 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:07.638454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a09e67-3874-44fa-9bc6-eee9a4464666 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:07.645302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a09e67-3874-44fa-9bc6-eee9a4464666 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:07.645920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a09e67-3874-44fa-9bc6-eee9a4464666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:07.647553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a09e67-3874-44fa-9bc6-eee9a4464666 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:07.662811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 359/716] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:55:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:07.664454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16668e59-5a7b-4e6f-8b83-ff601abc12d9 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:07.665032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16668e59-5a7b-4e6f-8b83-ff601abc12d9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:07.665194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16668e59-5a7b-4e6f-8b83-ff601abc12d9 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:07.666801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 360/717] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:07.669189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16668e59-5a7b-4e6f-8b83-ff601abc12d9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:07.713189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706bf09-5a3e-4f69-ad94-479853c71da2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:07.748229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6fddc-b282-4844-bc05-6c11163dff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:07.748924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6fddc-b282-4844-bc05-6c11163dff28 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:07.749207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6fddc-b282-4844-bc05-6c11163dff28 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:07.749481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6fddc-b282-4844-bc05-6c11163dff28 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:07.750377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6fddc-b282-4844-bc05-6c11163dff28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:07.750710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6fddc-b282-4844-bc05-6c11163dff28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:07.752148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6fddc-b282-4844-bc05-6c11163dff28 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:07.756240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:07.769788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 358/718] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 20 05:55:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:07.770768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a3e5-d285-4fff-bad1-6fcf03301e93 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:07.771053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a3e5-d285-4fff-bad1-6fcf03301e93 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:07.771328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a3e5-d285-4fff-bad1-6fcf03301e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:07.785483 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16668e59-5a7b-4e6f-8b83-ff601abc12d9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:07.787229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-ee36a3e5-d285-4fff-bad1-6fcf03301e93 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:07.788527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ee36a3e5-d285-4fff-bad1-6fcf03301e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:07.799300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:07.820203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2e9bd-0169-481d-9686-41a49433c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:07.821327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e9bd-0169-481d-9686-41a49433c725 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:07.821753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e9bd-0169-481d-9686-41a49433c725 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:07.822020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2e9bd-0169-481d-9686-41a49433c725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:07.832988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2e9bd-0169-481d-9686-41a49433c725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:07.834953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2e9bd-0169-481d-9686-41a49433c725 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-aca2e9bd-0169-481d-9686-41a49433c725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:07.852211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:07.853167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:07.854103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:07.854103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:07.854103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:07.854103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:07.854103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 361/719] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:07.854907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445ac37-34d1-44f0-aae8-d1b662b9f616 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:07.854907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445ac37-34d1-44f0-aae8-d1b662b9f616 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:07.855192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445ac37-34d1-44f0-aae8-d1b662b9f616 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:07.861083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 362/720] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:07.861738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445ac37-34d1-44f0-aae8-d1b662b9f616 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:07.872501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 359/721] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:55:07.872501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36a3e5-d285-4fff-bad1-6fcf03301e93 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:07.976865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445ac37-34d1-44f0-aae8-d1b662b9f616 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:07.980334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36a3e5-d285-4fff-bad1-6fcf03301e93 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:08.004484 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:08.014061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5e82-2041-4150-b798-70b5b57f206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:08.014966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5e82-2041-4150-b798-70b5b57f206d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.015457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5e82-2041-4150-b798-70b5b57f206d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.015700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03249331-98a4-449a-b258-326b2fe86024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:08.016118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba5e82-2041-4150-b798-70b5b57f206d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.016374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03249331-98a4-449a-b258-326b2fe86024 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.016865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03249331-98a4-449a-b258-326b2fe86024 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.017350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03249331-98a4-449a-b258-326b2fe86024 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.018235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03249331-98a4-449a-b258-326b2fe86024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:08.018605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03249331-98a4-449a-b258-326b2fe86024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:08.019952 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03249331-98a4-449a-b258-326b2fe86024 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:08.033920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 360/722] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:08.035228 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c585ba-785e-4af7-adad-996eacbded90 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.035522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c585ba-785e-4af7-adad-996eacbded90 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.035800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c585ba-785e-4af7-adad-996eacbded90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.048177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:08.053798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a7c585ba-785e-4af7-adad-996eacbded90 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:08.055017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a7c585ba-785e-4af7-adad-996eacbded90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:08.094438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba5e82-2041-4150-b798-70b5b57f206d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:08.095888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba5e82-2041-4150-b798-70b5b57f206d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:08.131764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 361/723] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:55:08.132891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c585ba-785e-4af7-adad-996eacbded90 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:08.205658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 363/724] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:55:08.206911 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5e82-2041-4150-b798-70b5b57f206d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:08.240147 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:08.254593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c585ba-785e-4af7-adad-996eacbded90 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:08.291888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61c96d-659f-4651-9127-17e0c9de8d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:08.293057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61c96d-659f-4651-9127-17e0c9de8d0d None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.293522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61c96d-659f-4651-9127-17e0c9de8d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.293972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61c96d-659f-4651-9127-17e0c9de8d0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.297038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:08.306224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61c96d-659f-4651-9127-17e0c9de8d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-3e61c96d-659f-4651-9127-17e0c9de8d0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:08.314490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:08.315427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:08.316274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 362/725] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:08.317472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61c96d-659f-4651-9127-17e0c9de8d0d None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:08.322978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba5e82-2041-4150-b798-70b5b57f206d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:08.358379 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd3530-53c4-4ce7-b172-dfac2ee94224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:08.359183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd3530-53c4-4ce7-b172-dfac2ee94224 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.359465 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd3530-53c4-4ce7-b172-dfac2ee94224 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.359740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd3530-53c4-4ce7-b172-dfac2ee94224 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.366860 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd3530-53c4-4ce7-b172-dfac2ee94224 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:08.368327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd3530-53c4-4ce7-b172-dfac2ee94224 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-34fd3530-53c4-4ce7-b172-dfac2ee94224 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:08.384154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:08.385246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:08.386184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:08.386184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:08.386184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:08.386184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:08.386184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:08.386184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:08.386184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:08.386184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:08.386184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:08.386184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:08.389985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 364/726] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 20 05:55:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:08.390630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd3530-53c4-4ce7-b172-dfac2ee94224 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:08.424932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61c96d-659f-4651-9127-17e0c9de8d0d None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:08.459800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e070038-515b-49e2-845d-94553e062be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:08.460545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070038-515b-49e2-845d-94553e062be9 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.460834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070038-515b-49e2-845d-94553e062be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.461113 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e070038-515b-49e2-845d-94553e062be9 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.461832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e070038-515b-49e2-845d-94553e062be9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:08.463211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e070038-515b-49e2-845d-94553e062be9 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:08.478904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 363/727] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:55:08 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:55:08.479784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e070038-515b-49e2-845d-94553e062be9 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:08.500156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:08.521332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd3530-53c4-4ce7-b172-dfac2ee94224 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:08.546673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:08.577986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c50108-bed7-401f-9a10-161530d56172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:08.579395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c50108-bed7-401f-9a10-161530d56172 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.579836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c50108-bed7-401f-9a10-161530d56172 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.580112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c50108-bed7-401f-9a10-161530d56172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.592362 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c50108-bed7-401f-9a10-161530d56172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:08.593945 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c50108-bed7-401f-9a10-161530d56172 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:08.603720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e070038-515b-49e2-845d-94553e062be9 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-75c50108-bed7-401f-9a10-161530d56172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:08.612548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:08.613514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:08.614401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:08.614401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:08.614401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:08.614401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:08.614401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 365/728] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:08.615446 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c50108-bed7-401f-9a10-161530d56172 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:08.648430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9344e51-aed4-4c70-8f56-5b015e498196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:08.649107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9344e51-aed4-4c70-8f56-5b015e498196 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.649394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9344e51-aed4-4c70-8f56-5b015e498196 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.649662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9344e51-aed4-4c70-8f56-5b015e498196 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.650908 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9344e51-aed4-4c70-8f56-5b015e498196 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:08.651016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9344e51-aed4-4c70-8f56-5b015e498196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:08.652379 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9344e51-aed4-4c70-8f56-5b015e498196 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:08.661180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 364/729] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:55:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:08.663179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f9df-e727-4a85-803c-b09c7310b1fd None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.663521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f9df-e727-4a85-803c-b09c7310b1fd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.663802 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3f9df-e727-4a85-803c-b09c7310b1fd None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.665261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 365/730] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:08.667369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3f9df-e727-4a85-803c-b09c7310b1fd None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:08.745095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c50108-bed7-401f-9a10-161530d56172 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:08.770753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3f9df-e727-4a85-803c-b09c7310b1fd None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:08.782221 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc0b29-b8d9-4c30-82f2-65f1f25b18fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:08.783399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc0b29-b8d9-4c30-82f2-65f1f25b18fb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.783887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc0b29-b8d9-4c30-82f2-65f1f25b18fb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.784507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc0b29-b8d9-4c30-82f2-65f1f25b18fb None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.786082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc0b29-b8d9-4c30-82f2-65f1f25b18fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:08.786681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc0b29-b8d9-4c30-82f2-65f1f25b18fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:08.788982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:08.789444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc0b29-b8d9-4c30-82f2-65f1f25b18fb None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:08.793321 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:08.807145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554733d2-db95-4518-8535-5eb64bfa9dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:08.807741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554733d2-db95-4518-8535-5eb64bfa9dee None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.808027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554733d2-db95-4518-8535-5eb64bfa9dee None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.808304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554733d2-db95-4518-8535-5eb64bfa9dee None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.809065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554733d2-db95-4518-8535-5eb64bfa9dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:08.809379 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554733d2-db95-4518-8535-5eb64bfa9dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:08.810751 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554733d2-db95-4518-8535-5eb64bfa9dee None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:08.818069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 366/731] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 20 05:55:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:08.818069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc0b29-b8d9-4c30-82f2-65f1f25b18fb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:08.824788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 366/732] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:08.829196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84787222-5a8c-4b3e-84e0-655fecf75cdc None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.829196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84787222-5a8c-4b3e-84e0-655fecf75cdc None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.829196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84787222-5a8c-4b3e-84e0-655fecf75cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.846214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-84787222-5a8c-4b3e-84e0-655fecf75cdc None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:08.847402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-84787222-5a8c-4b3e-84e0-655fecf75cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:08.919810 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 367/733] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 05:55:08.920457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc0b29-b8d9-4c30-82f2-65f1f25b18fb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:08.920671 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84787222-5a8c-4b3e-84e0-655fecf75cdc None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:08.969199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ec83f-809b-442e-9f26-5219426db336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:08.969996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ec83f-809b-442e-9f26-5219426db336 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:08.970280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ec83f-809b-442e-9f26-5219426db336 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:08.970560 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ec83f-809b-442e-9f26-5219426db336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:08.981815 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ec83f-809b-442e-9f26-5219426db336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:08.983293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ec83f-809b-442e-9f26-5219426db336 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-590ec83f-809b-442e-9f26-5219426db336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:09.001746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:09.002660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:09.003546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:09.003546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:09.003546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:09.003546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:09.003546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 367/734] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:09.003819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ec83f-809b-442e-9f26-5219426db336 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:09.045763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84787222-5a8c-4b3e-84e0-655fecf75cdc None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:09.052646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:09.055611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:09.082445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da28d8-0591-4829-833e-6bf8a230b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:09.083016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da28d8-0591-4829-833e-6bf8a230b884 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:09.083300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da28d8-0591-4829-833e-6bf8a230b884 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:09.083954 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da28d8-0591-4829-833e-6bf8a230b884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:09.111715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ec83f-809b-442e-9f26-5219426db336 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:09.150213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268f012-478b-459b-89c2-40b88569e798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:09.151267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268f012-478b-459b-89c2-40b88569e798 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:09.151552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268f012-478b-459b-89c2-40b88569e798 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:09.151829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268f012-478b-459b-89c2-40b88569e798 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:09.156915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da28d8-0591-4829-833e-6bf8a230b884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:09.158598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da28d8-0591-4829-833e-6bf8a230b884 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:09.159074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268f012-478b-459b-89c2-40b88569e798 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:09.160567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268f012-478b-459b-89c2-40b88569e798 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-4268f012-478b-459b-89c2-40b88569e798 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:09.174237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:09.175293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:09.176241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:09.176241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:09.176241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:09.176241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:09.176241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:09.176241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:09.176241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:09.176241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:09.176241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 368/735] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:09.176241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268f012-478b-459b-89c2-40b88569e798 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:09.278401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 368/736] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:08 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 05:55:09.283428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da28d8-0591-4829-833e-6bf8a230b884 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:09.283593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268f012-478b-459b-89c2-40b88569e798 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:09.292682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:09.294553 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:09.324804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23252c59-fc86-4bde-8746-e19f548ce92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:09.325459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252c59-fc86-4bde-8746-e19f548ce92f None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:09.326118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252c59-fc86-4bde-8746-e19f548ce92f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:09.326407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23252c59-fc86-4bde-8746-e19f548ce92f None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:09.327124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23252c59-fc86-4bde-8746-e19f548ce92f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:09.328862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23252c59-fc86-4bde-8746-e19f548ce92f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:09.344450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 369/737] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:55:09 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:55:09.345305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23252c59-fc86-4bde-8746-e19f548ce92f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:09.414096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da28d8-0591-4829-833e-6bf8a230b884 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:09.472550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23252c59-fc86-4bde-8746-e19f548ce92f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:09.473202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d50ad-8794-4595-a668-6a6b2a0320b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:09.474386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d50ad-8794-4595-a668-6a6b2a0320b5 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:09.476401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d50ad-8794-4595-a668-6a6b2a0320b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:09.476946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d50ad-8794-4595-a668-6a6b2a0320b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:09.477945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d50ad-8794-4595-a668-6a6b2a0320b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:09.478467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d50ad-8794-4595-a668-6a6b2a0320b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:09.480177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d50ad-8794-4595-a668-6a6b2a0320b5 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:09.501813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 369/738] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:09.501813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d50ad-8794-4595-a668-6a6b2a0320b5 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:09.529796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87064852-79ef-4161-be44-f0d2051ef823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:09.530466 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064852-79ef-4161-be44-f0d2051ef823 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:09.530753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064852-79ef-4161-be44-f0d2051ef823 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:09.531030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064852-79ef-4161-be44-f0d2051ef823 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:09.531822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87064852-79ef-4161-be44-f0d2051ef823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:09.532138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87064852-79ef-4161-be44-f0d2051ef823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:09.533612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87064852-79ef-4161-be44-f0d2051ef823 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:09.552156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 370/739] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:09.553096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87064852-79ef-4161-be44-f0d2051ef823 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:09.581580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:09.594423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:09.639909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d50ad-8794-4595-a668-6a6b2a0320b5 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:09.672529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87064852-79ef-4161-be44-f0d2051ef823 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:09.675783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494c9de-fb5c-4abc-bf9a-5e74bd567d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:09.676862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494c9de-fb5c-4abc-bf9a-5e74bd567d54 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:09.677357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494c9de-fb5c-4abc-bf9a-5e74bd567d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:09.677818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494c9de-fb5c-4abc-bf9a-5e74bd567d54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:09.689367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494c9de-fb5c-4abc-bf9a-5e74bd567d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:09.691088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494c9de-fb5c-4abc-bf9a-5e74bd567d54 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:09.709808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0511-0413-44ef-886f-b435671d5536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-1494c9de-fb5c-4abc-bf9a-5e74bd567d54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:09.710020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:09.711033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:09.712138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:09.712138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:09.712138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:09.712138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:09.713256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 370/740] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:09.713514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0511-0413-44ef-886f-b435671d5536 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:09.714013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0511-0413-44ef-886f-b435671d5536 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:09.714328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494c9de-fb5c-4abc-bf9a-5e74bd567d54 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:09.714614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0511-0413-44ef-886f-b435671d5536 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:09.722646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a0511-0413-44ef-886f-b435671d5536 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:09.724445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a0511-0413-44ef-886f-b435671d5536 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-791a0511-0413-44ef-886f-b435671d5536 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:09.743304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:09.744343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:09.745345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:09.745345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:09.745345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:09.745345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:09.745345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:09.745345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:09.745345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:09.745345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:09.745345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:55:09.745345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:09.747886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 371/741] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:09.749591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0511-0413-44ef-886f-b435671d5536 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:09.828271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494c9de-fb5c-4abc-bf9a-5e74bd567d54 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:09.845136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:09.856773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:09.866707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de4e4-443d-4711-8daf-112e55297bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:09.867383 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de4e4-443d-4711-8daf-112e55297bbb None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:09.867751 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de4e4-443d-4711-8daf-112e55297bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:09.868039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28de4e4-443d-4711-8daf-112e55297bbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:09.868834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0511-0413-44ef-886f-b435671d5536 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:09.869642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28de4e4-443d-4711-8daf-112e55297bbb None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=cbe8aea409c3459f9f7b3c3ef6ff583b) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:09.870032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28de4e4-443d-4711-8daf-112e55297bbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:09.872477 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28de4e4-443d-4711-8daf-112e55297bbb None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:09.881857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 371/742] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:09 2022] GET /identity/v3/role_assignments?user.id=cbe8aea409c3459f9f7b3c3ef6ff583b&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:09.884185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de4e4-443d-4711-8daf-112e55297bbb None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:09.914838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cc2db-cf9e-487b-88f3-f8f7df628b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:09.915575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cc2db-cf9e-487b-88f3-f8f7df628b50 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:09.915934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cc2db-cf9e-487b-88f3-f8f7df628b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:09.916282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cc2db-cf9e-487b-88f3-f8f7df628b50 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:09.917152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cc2db-cf9e-487b-88f3-f8f7df628b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:09.917535 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cc2db-cf9e-487b-88f3-f8f7df628b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:09.919047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cc2db-cf9e-487b-88f3-f8f7df628b50 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:09.936597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 372/743] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:09.942774 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cc2db-cf9e-487b-88f3-f8f7df628b50 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:10.092368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28de4e4-443d-4711-8daf-112e55297bbb None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:10.093288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cc2db-cf9e-487b-88f3-f8f7df628b50 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:10.133367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a9cd8-a149-424a-89d1-f5aee3d84722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:10.134489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a9cd8-a149-424a-89d1-f5aee3d84722 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:10.135076 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a9cd8-a149-424a-89d1-f5aee3d84722 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:10.135924 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b34b99-24f7-47ea-991c-1aa9947b285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:10.136463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a9cd8-a149-424a-89d1-f5aee3d84722 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:10.136777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b34b99-24f7-47ea-991c-1aa9947b285b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:10.137067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b34b99-24f7-47ea-991c-1aa9947b285b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:10.137344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b34b99-24f7-47ea-991c-1aa9947b285b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:10.138234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a9cd8-a149-424a-89d1-f5aee3d84722 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:10.138750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a9cd8-a149-424a-89d1-f5aee3d84722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:10.140453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a9cd8-a149-424a-89d1-f5aee3d84722 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:10.145166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b34b99-24f7-47ea-991c-1aa9947b285b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:10.146633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b34b99-24f7-47ea-991c-1aa9947b285b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:10.162592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 372/744] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 20 05:55:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-11b34b99-24f7-47ea-991c-1aa9947b285b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:10.166625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:10.167495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:10.168411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:10.168411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:10.168411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:10.168411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:10.168411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:10.168411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:10.168411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:10.168411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:10.171189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a9cd8-a149-424a-89d1-f5aee3d84722 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:10.172217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 373/745] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:10.179999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b34b99-24f7-47ea-991c-1aa9947b285b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:10.192514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:10.264210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:10.353669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a9cd8-a149-424a-89d1-f5aee3d84722 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:10.389874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04c74a-52c2-45b6-a352-a7fbfea443cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:10.390685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04c74a-52c2-45b6-a352-a7fbfea443cf None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:10.391072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04c74a-52c2-45b6-a352-a7fbfea443cf None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:10.391456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04c74a-52c2-45b6-a352-a7fbfea443cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:10.398807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b34b99-24f7-47ea-991c-1aa9947b285b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:10.463736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04c74a-52c2-45b6-a352-a7fbfea443cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:10.465390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04c74a-52c2-45b6-a352-a7fbfea443cf None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:10.473672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c49f3b-063c-4e93-9a69-79ee7dc0a693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:10.474348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c49f3b-063c-4e93-9a69-79ee7dc0a693 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:10.474633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c49f3b-063c-4e93-9a69-79ee7dc0a693 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:10.474940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c49f3b-063c-4e93-9a69-79ee7dc0a693 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:10.475741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c49f3b-063c-4e93-9a69-79ee7dc0a693 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:10.476043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c49f3b-063c-4e93-9a69-79ee7dc0a693 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:10.477544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c49f3b-063c-4e93-9a69-79ee7dc0a693 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:10.502778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 374/746] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:10.509178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:10.509694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c49f3b-063c-4e93-9a69-79ee7dc0a693 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:10.581428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 373/747] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:55:10.587516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04c74a-52c2-45b6-a352-a7fbfea443cf None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:10.592857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:10.646194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c49f3b-063c-4e93-9a69-79ee7dc0a693 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:10.682364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324be9e-ab48-45d4-ad92-100a79b06f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:10.683025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324be9e-ab48-45d4-ad92-100a79b06f17 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:10.683309 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324be9e-ab48-45d4-ad92-100a79b06f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:10.683591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324be9e-ab48-45d4-ad92-100a79b06f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:10.684602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324be9e-ab48-45d4-ad92-100a79b06f17 None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=25a82cc64a424e3d87062043f24d5285) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:10.684919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324be9e-ab48-45d4-ad92-100a79b06f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:10.687143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324be9e-ab48-45d4-ad92-100a79b06f17 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:10.693271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 375/748] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:10 2022] GET /identity/v3/role_assignments?user.id=25a82cc64a424e3d87062043f24d5285&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:10.695377 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375ff4-bf34-4540-acc5-49d2ca9d2581 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:10.695496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375ff4-bf34-4540-acc5-49d2ca9d2581 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:10.695758 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4375ff4-bf34-4540-acc5-49d2ca9d2581 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:10.697453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 376/749] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:10.698936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04c74a-52c2-45b6-a352-a7fbfea443cf None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:10.708354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1263ada-2a5d-4681-a5ee-806edb6d7b06 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:10.708354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1263ada-2a5d-4681-a5ee-806edb6d7b06 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:10.708354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1263ada-2a5d-4681-a5ee-806edb6d7b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:10.742460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d1263ada-2a5d-4681-a5ee-806edb6d7b06 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:10.743604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d1263ada-2a5d-4681-a5ee-806edb6d7b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:10.801184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c88f9-4c4c-4dd8-8bb1-53af7ad46cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:10.802007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c88f9-4c4c-4dd8-8bb1-53af7ad46cee None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:10.802293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c88f9-4c4c-4dd8-8bb1-53af7ad46cee None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:10.802569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c88f9-4c4c-4dd8-8bb1-53af7ad46cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:10.821686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:10.829072 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 377/750] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:10.830181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c88f9-4c4c-4dd8-8bb1-53af7ad46cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:10.831667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c88f9-4c4c-4dd8-8bb1-53af7ad46cee None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-389c88f9-4c4c-4dd8-8bb1-53af7ad46cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:10.859222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:10.860218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:10.861148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:10.861148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:10.861148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:10.861148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:10.861148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 374/751] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:10.863487 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1263ada-2a5d-4681-a5ee-806edb6d7b06 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:10.871758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c88f9-4c4c-4dd8-8bb1-53af7ad46cee None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:10.973932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:10.998102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c88f9-4c4c-4dd8-8bb1-53af7ad46cee None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:11.021588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1263ada-2a5d-4681-a5ee-806edb6d7b06 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:11.059625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ac057-eef1-42de-8da1-6f5865fa0151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:11.060463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ac057-eef1-42de-8da1-6f5865fa0151 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:11.060747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ac057-eef1-42de-8da1-6f5865fa0151 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:11.060960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be07ab6-3fdd-46fd-b233-1a022fe591bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:11.061082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ac057-eef1-42de-8da1-6f5865fa0151 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:11.061596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be07ab6-3fdd-46fd-b233-1a022fe591bd None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:11.061705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ac057-eef1-42de-8da1-6f5865fa0151 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:11.061884 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be07ab6-3fdd-46fd-b233-1a022fe591bd None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:11.062167 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be07ab6-3fdd-46fd-b233-1a022fe591bd None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:11.062907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be07ab6-3fdd-46fd-b233-1a022fe591bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:11.063079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ac057-eef1-42de-8da1-6f5865fa0151 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:11.063248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be07ab6-3fdd-46fd-b233-1a022fe591bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:11.064601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be07ab6-3fdd-46fd-b233-1a022fe591bd None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-0e1ac057-eef1-42de-8da1-6f5865fa0151 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:11.075611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:11.076586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:11.077440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 378/752] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jun 20 05:55:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:11.083192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 375/753] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:11.085265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ac057-eef1-42de-8da1-6f5865fa0151 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:11.088954 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be07ab6-3fdd-46fd-b233-1a022fe591bd None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:11.207694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:11.260648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be07ab6-3fdd-46fd-b233-1a022fe591bd None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:11.273879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ac057-eef1-42de-8da1-6f5865fa0151 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:11.296393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c73511-510d-409e-a1fd-12a6a7f606f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:11.297252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73511-510d-409e-a1fd-12a6a7f606f0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:11.297604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73511-510d-409e-a1fd-12a6a7f606f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:11.297891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c73511-510d-409e-a1fd-12a6a7f606f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:11.305433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c73511-510d-409e-a1fd-12a6a7f606f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:11.306909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c73511-510d-409e-a1fd-12a6a7f606f0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:11.314689 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-75c73511-510d-409e-a1fd-12a6a7f606f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:11.321776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:11.322665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:11.323533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:11.323533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:11.323533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:11.323533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:11.323533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:11.323533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:11.323533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:11.323533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:11.323533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 376/754] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:11.337602 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c73511-510d-409e-a1fd-12a6a7f606f0 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:11.337854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539bb70-7d23-4be1-8bc5-45a8641b66e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:11.338592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539bb70-7d23-4be1-8bc5-45a8641b66e7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:11.338879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539bb70-7d23-4be1-8bc5-45a8641b66e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:11.339157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539bb70-7d23-4be1-8bc5-45a8641b66e7 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:11.339979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539bb70-7d23-4be1-8bc5-45a8641b66e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:11.340456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539bb70-7d23-4be1-8bc5-45a8641b66e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:11.341954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539bb70-7d23-4be1-8bc5-45a8641b66e7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:11.347251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 379/755] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 20 05:55:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:11.352653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539bb70-7d23-4be1-8bc5-45a8641b66e7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:11.520843 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539bb70-7d23-4be1-8bc5-45a8641b66e7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:11.563953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c73511-510d-409e-a1fd-12a6a7f606f0 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:11.565678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad6ba3-21bd-40d4-a997-f07b2b3cdb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:11.566441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6ba3-21bd-40d4-a997-f07b2b3cdb14 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:11.566827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6ba3-21bd-40d4-a997-f07b2b3cdb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:11.567203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad6ba3-21bd-40d4-a997-f07b2b3cdb14 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:11.568238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad6ba3-21bd-40d4-a997-f07b2b3cdb14 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:11.568801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad6ba3-21bd-40d4-a997-f07b2b3cdb14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:11.570577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad6ba3-21bd-40d4-a997-f07b2b3cdb14 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:11.577593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 380/756] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 20 05:55:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:11.583430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad6ba3-21bd-40d4-a997-f07b2b3cdb14 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:11.589655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:11.641594 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:11.681011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085f611-80a5-4d21-b9ae-6e6c9cd53098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:11.681689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085f611-80a5-4d21-b9ae-6e6c9cd53098 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:11.681976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085f611-80a5-4d21-b9ae-6e6c9cd53098 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:11.682256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085f611-80a5-4d21-b9ae-6e6c9cd53098 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:11.683057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085f611-80a5-4d21-b9ae-6e6c9cd53098 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:11.683376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085f611-80a5-4d21-b9ae-6e6c9cd53098 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:11.684901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085f611-80a5-4d21-b9ae-6e6c9cd53098 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:11.698475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad6ba3-21bd-40d4-a997-f07b2b3cdb14 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:11.718619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 377/757] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:11.723960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085f611-80a5-4d21-b9ae-6e6c9cd53098 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:11.742712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53a50f-2686-4e14-a3b0-eb3ea992e11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:11.743431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53a50f-2686-4e14-a3b0-eb3ea992e11f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:11.743719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53a50f-2686-4e14-a3b0-eb3ea992e11f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:11.743997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53a50f-2686-4e14-a3b0-eb3ea992e11f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:11.744835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53a50f-2686-4e14-a3b0-eb3ea992e11f None admin] RBAC: Adding query filter params (interface=public, service_id=40635d492d754d33b9cc5f3c4c171d1a, region_id=RegionOne) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:11.745150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53a50f-2686-4e14-a3b0-eb3ea992e11f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:11.746586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53a50f-2686-4e14-a3b0-eb3ea992e11f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:11.764577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 381/758] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 20 05:55:11 2022] GET /identity/v3/endpoints?service_id=40635d492d754d33b9cc5f3c4c171d1a&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:11.770130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53a50f-2686-4e14-a3b0-eb3ea992e11f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:11.897229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085f611-80a5-4d21-b9ae-6e6c9cd53098 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:11.964335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea8aa0-8fe2-447a-9068-832a73ae8a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:11.965081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8aa0-8fe2-447a-9068-832a73ae8a45 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:11.965368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8aa0-8fe2-447a-9068-832a73ae8a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:11.965648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8aa0-8fe2-447a-9068-832a73ae8a45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:11.966574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea8aa0-8fe2-447a-9068-832a73ae8a45 None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=265894b988a640f0b17846d4986b670a) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:11.966895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea8aa0-8fe2-447a-9068-832a73ae8a45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:11.968784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea8aa0-8fe2-447a-9068-832a73ae8a45 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:11.975985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 378/759] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:11 2022] GET /identity/v3/role_assignments?user.id=265894b988a640f0b17846d4986b670a&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:11.977501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e70b-6345-423c-aee5-6f6f8e51ba39 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:11.977797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e70b-6345-423c-aee5-6f6f8e51ba39 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:11.978149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e70b-6345-423c-aee5-6f6f8e51ba39 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:11.979982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 379/760] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:11.983634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53a50f-2686-4e14-a3b0-eb3ea992e11f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:11.997775 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748994db-006c-4012-82d5-04388da92d10 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:11.998121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748994db-006c-4012-82d5-04388da92d10 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:11.998340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748994db-006c-4012-82d5-04388da92d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:12.022754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-748994db-006c-4012-82d5-04388da92d10 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:12.023997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-748994db-006c-4012-82d5-04388da92d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:12.024666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:12.068587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9117-1594-47f0-8aad-494d1a46e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:12.069566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9117-1594-47f0-8aad-494d1a46e5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:12.069851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9117-1594-47f0-8aad-494d1a46e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:12.070130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9117-1594-47f0-8aad-494d1a46e5f0 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:12.070842 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9117-1594-47f0-8aad-494d1a46e5f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:12.072271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9117-1594-47f0-8aad-494d1a46e5f0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:12.082524 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 382/761] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 20 05:55:11 2022] GET /identity/v3/services => generated 772 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:12.086487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:12.133093 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 380/762] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:12.167765 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9117-1594-47f0-8aad-494d1a46e5f0 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:12.315498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9117-1594-47f0-8aad-494d1a46e5f0 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:12.350849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45f155-93bb-4269-a0ad-8641a13f478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:12.351647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45f155-93bb-4269-a0ad-8641a13f478e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:12.351933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45f155-93bb-4269-a0ad-8641a13f478e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:12.352214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45f155-93bb-4269-a0ad-8641a13f478e None admin] PATH_INFO: `/v3/services/network` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:12.352908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45f155-93bb-4269-a0ad-8641a13f478e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:12.354301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45f155-93bb-4269-a0ad-8641a13f478e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-af45f155-93bb-4269-a0ad-8641a13f478e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:12.366893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:12.367932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:12.368814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 383/763] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:12 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:12.373933 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748994db-006c-4012-82d5-04388da92d10 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:12.469373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a553d12-1f6e-46ba-a7ad-edd615f31064 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:12.469620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a553d12-1f6e-46ba-a7ad-edd615f31064 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:12.470008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a553d12-1f6e-46ba-a7ad-edd615f31064 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:12.471578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 384/764] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:12.478763 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ba4d-2ed3-4850-80f7-97cf28e1aeb1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:12.479300 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ba4d-2ed3-4850-80f7-97cf28e1aeb1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:12.479904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ba4d-2ed3-4850-80f7-97cf28e1aeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:12.498876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-06d4ba4d-2ed3-4850-80f7-97cf28e1aeb1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:12.500414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-06d4ba4d-2ed3-4850-80f7-97cf28e1aeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:12.507190 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748994db-006c-4012-82d5-04388da92d10 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:12.554944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a22e4-91c2-47a6-8567-e1bb4470b1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:12.556080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a22e4-91c2-47a6-8567-e1bb4470b1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:12.557656 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a22e4-91c2-47a6-8567-e1bb4470b1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:12.558193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a22e4-91c2-47a6-8567-e1bb4470b1d2 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:12.559739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a22e4-91c2-47a6-8567-e1bb4470b1d2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:12.560797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a22e4-91c2-47a6-8567-e1bb4470b1d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:12.562529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a22e4-91c2-47a6-8567-e1bb4470b1d2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:12.572663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:12.574844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 381/765] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:12.580682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a22e4-91c2-47a6-8567-e1bb4470b1d2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:12.629371 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:12.637683 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 385/766] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:12.662878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ba4d-2ed3-4850-80f7-97cf28e1aeb1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:12.784179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a22e4-91c2-47a6-8567-e1bb4470b1d2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:12.847569 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ba4d-2ed3-4850-80f7-97cf28e1aeb1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:12.854921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38bb1f-040c-4fdc-9b55-cec977659075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:12.857002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38bb1f-040c-4fdc-9b55-cec977659075 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:12.857290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38bb1f-040c-4fdc-9b55-cec977659075 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:12.857572 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38bb1f-040c-4fdc-9b55-cec977659075 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:12.858277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38bb1f-040c-4fdc-9b55-cec977659075 None admin] RBAC: Adding query filter params (type=network) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:12.858586 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38bb1f-040c-4fdc-9b55-cec977659075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:12.860730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38bb1f-040c-4fdc-9b55-cec977659075 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:12.878367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 382/767] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:12.884095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38bb1f-040c-4fdc-9b55-cec977659075 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:12.952577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc0e9d-617b-40fa-8cd1-e18d8c46f534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:12.954848 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc0e9d-617b-40fa-8cd1-e18d8c46f534 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:12.956509 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc0e9d-617b-40fa-8cd1-e18d8c46f534 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:12.957014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc0e9d-617b-40fa-8cd1-e18d8c46f534 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:12.980106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc0e9d-617b-40fa-8cd1-e18d8c46f534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-18fc0e9d-617b-40fa-8cd1-e18d8c46f534 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:12.994728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:12.995673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:12.996592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:13.002745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 386/768] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:13.009618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc0e9d-617b-40fa-8cd1-e18d8c46f534 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:13.019335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:13.029579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38bb1f-040c-4fdc-9b55-cec977659075 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:13.067387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:13.067570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdaad47-cd41-48e7-9850-64f8fdd3cb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:13.068257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaad47-cd41-48e7-9850-64f8fdd3cb5f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:13.068729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaad47-cd41-48e7-9850-64f8fdd3cb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:13.069075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdaad47-cd41-48e7-9850-64f8fdd3cb5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:13.069947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdaad47-cd41-48e7-9850-64f8fdd3cb5f None admin] RBAC: Adding query filter params (interface=public, service_id=5460ccdfa95d4da0af3cb7531141c9ee, region_id=RegionOne) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:13.070330 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdaad47-cd41-48e7-9850-64f8fdd3cb5f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:13.071771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdaad47-cd41-48e7-9850-64f8fdd3cb5f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:13.084931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 383/769] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 20 05:55:12 2022] GET /identity/v3/endpoints?service_id=5460ccdfa95d4da0af3cb7531141c9ee&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:13.086700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3cdf3-660e-416e-9737-f8f26510ed5a None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:13.087023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3cdf3-660e-416e-9737-f8f26510ed5a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:13.087652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3cdf3-660e-416e-9737-f8f26510ed5a None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:13.093266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 384/770] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:13.094260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3cdf3-660e-416e-9737-f8f26510ed5a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:13.142005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc0e9d-617b-40fa-8cd1-e18d8c46f534 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:13.187780 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f657085-6a33-4d50-b632-38423a03e999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:13.188478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657085-6a33-4d50-b632-38423a03e999 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:13.188762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657085-6a33-4d50-b632-38423a03e999 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:13.189041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f657085-6a33-4d50-b632-38423a03e999 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:13.189821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f657085-6a33-4d50-b632-38423a03e999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:13.190385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f657085-6a33-4d50-b632-38423a03e999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:13.191627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f657085-6a33-4d50-b632-38423a03e999 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:13.205302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 387/771] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:55:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:13.205302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362bfd8-8635-42d3-af04-6550bee97050 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:13.205302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362bfd8-8635-42d3-af04-6550bee97050 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:13.205302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362bfd8-8635-42d3-af04-6550bee97050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:13.223632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3cdf3-660e-416e-9737-f8f26510ed5a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:13.225031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a362bfd8-8635-42d3-af04-6550bee97050 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:13.226365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a362bfd8-8635-42d3-af04-6550bee97050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:13.270664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacfbbd-db02-4ab1-865b-02badb8c0976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:13.272300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacfbbd-db02-4ab1-865b-02badb8c0976 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:13.272789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacfbbd-db02-4ab1-865b-02badb8c0976 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:13.273250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacfbbd-db02-4ab1-865b-02badb8c0976 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:13.274278 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacfbbd-db02-4ab1-865b-02badb8c0976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:13.276285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacfbbd-db02-4ab1-865b-02badb8c0976 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:13.283097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 385/772] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 20 05:55:13 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:13.284284 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacfbbd-db02-4ab1-865b-02badb8c0976 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:13.300678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 388/773] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:13.328782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:13.331157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362bfd8-8635-42d3-af04-6550bee97050 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:13.370443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:13.422134 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacfbbd-db02-4ab1-865b-02badb8c0976 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:13.467709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532469d-0fcd-4392-b51e-acfc31ea87ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:13.468704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532469d-0fcd-4392-b51e-acfc31ea87ff None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:13.469090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532469d-0fcd-4392-b51e-acfc31ea87ff None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:13.469467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532469d-0fcd-4392-b51e-acfc31ea87ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:13.482092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532469d-0fcd-4392-b51e-acfc31ea87ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:13.483576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532469d-0fcd-4392-b51e-acfc31ea87ff None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-6532469d-0fcd-4392-b51e-acfc31ea87ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:13.503054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:13.504028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:13.504990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:13.504990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:13.504990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:13.504990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:13.504990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 386/774] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:13.510464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532469d-0fcd-4392-b51e-acfc31ea87ff None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:13.530273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362bfd8-8635-42d3-af04-6550bee97050 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:13.573324 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adca0c-2325-44a1-a4f7-61b56c83e734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:13.574232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adca0c-2325-44a1-a4f7-61b56c83e734 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:13.574516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adca0c-2325-44a1-a4f7-61b56c83e734 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:13.574792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adca0c-2325-44a1-a4f7-61b56c83e734 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:13.597286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2adca0c-2325-44a1-a4f7-61b56c83e734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:13.608659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c2adca0c-2325-44a1-a4f7-61b56c83e734 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:13.609213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:13.610136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:55:13.610988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:13.612175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 389/775] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:55:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:13.616943 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adca0c-2325-44a1-a4f7-61b56c83e734 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:13.661765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532469d-0fcd-4392-b51e-acfc31ea87ff None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:13.728191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73ab86-5c2f-4daa-9c40-22a54ea746f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:13.728889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73ab86-5c2f-4daa-9c40-22a54ea746f6 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:13.731333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73ab86-5c2f-4daa-9c40-22a54ea746f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:13.731632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73ab86-5c2f-4daa-9c40-22a54ea746f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:13.732401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73ab86-5c2f-4daa-9c40-22a54ea746f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:13.732722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73ab86-5c2f-4daa-9c40-22a54ea746f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:13.734109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73ab86-5c2f-4daa-9c40-22a54ea746f6 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:13.772477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:13.774655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 387/776] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:13.780863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73ab86-5c2f-4daa-9c40-22a54ea746f6 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:13.794314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adca0c-2325-44a1-a4f7-61b56c83e734 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:13.830679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567469b0-df97-4538-ac28-b1720e0672f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:13.831722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567469b0-df97-4538-ac28-b1720e0672f9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:13.832204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567469b0-df97-4538-ac28-b1720e0672f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:13.833739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567469b0-df97-4538-ac28-b1720e0672f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:13.836076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567469b0-df97-4538-ac28-b1720e0672f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:13.836808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567469b0-df97-4538-ac28-b1720e0672f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:13.839725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567469b0-df97-4538-ac28-b1720e0672f9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:13.862341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 390/777] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:55:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:13.870713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567469b0-df97-4538-ac28-b1720e0672f9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:13.967672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73ab86-5c2f-4daa-9c40-22a54ea746f6 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:14.033491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567469b0-df97-4538-ac28-b1720e0672f9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:14.034128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:14.044710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae2db3-557a-4e3f-a09c-a18bb6016510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:14.045507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae2db3-557a-4e3f-a09c-a18bb6016510 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.046113 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae2db3-557a-4e3f-a09c-a18bb6016510 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.046240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae2db3-557a-4e3f-a09c-a18bb6016510 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.054443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae2db3-557a-4e3f-a09c-a18bb6016510 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:14.056050 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae2db3-557a-4e3f-a09c-a18bb6016510 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-aeae2db3-557a-4e3f-a09c-a18bb6016510 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:14.071730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:14.072759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:14.073678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:14.073678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:14.073678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:14.073678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:14.073678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:14.073678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:14.073678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:14.073678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:14.073678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:14.073678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:14.077682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 388/778] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 20 05:55:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:14.079880 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae2db3-557a-4e3f-a09c-a18bb6016510 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:14.110255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0077f-7d16-43c2-94fa-03f08f32c6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:14.111104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0077f-7d16-43c2-94fa-03f08f32c6ea None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.111398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0077f-7d16-43c2-94fa-03f08f32c6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.111676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0077f-7d16-43c2-94fa-03f08f32c6ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.137217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0077f-7d16-43c2-94fa-03f08f32c6ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:14.140516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0077f-7d16-43c2-94fa-03f08f32c6ea None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:14.148742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c3b0077f-7d16-43c2-94fa-03f08f32c6ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:14.176197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:14.177237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:14.178995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:14.178995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:14.178995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:14.178995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:14.178995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 391/779] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:14.183987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0077f-7d16-43c2-94fa-03f08f32c6ea None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:14.225499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae2db3-557a-4e3f-a09c-a18bb6016510 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:14.268619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc11cee-4b50-4e1a-9494-c5e712dacdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:14.269698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11cee-4b50-4e1a-9494-c5e712dacdfc None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.270231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11cee-4b50-4e1a-9494-c5e712dacdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.270712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11cee-4b50-4e1a-9494-c5e712dacdfc None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.272285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc11cee-4b50-4e1a-9494-c5e712dacdfc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:14.274560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc11cee-4b50-4e1a-9494-c5e712dacdfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:14.276495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc11cee-4b50-4e1a-9494-c5e712dacdfc None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:14.299844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 389/780] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 20 05:55:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:14.301352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc11cee-4b50-4e1a-9494-c5e712dacdfc None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:14.385039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0077f-7d16-43c2-94fa-03f08f32c6ea None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:14.404773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:14.438169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb8197-8af7-4858-a189-12e858adac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:14.439203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb8197-8af7-4858-a189-12e858adac62 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.439714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb8197-8af7-4858-a189-12e858adac62 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.440200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb8197-8af7-4858-a189-12e858adac62 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.441999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb8197-8af7-4858-a189-12e858adac62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:14.442571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb8197-8af7-4858-a189-12e858adac62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:14.444238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb8197-8af7-4858-a189-12e858adac62 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:14.468468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 392/781] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:14.474151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb8197-8af7-4858-a189-12e858adac62 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:14.486783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc11cee-4b50-4e1a-9494-c5e712dacdfc None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:14.523805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eb92c-bf53-4be1-a7f4-9eee5f2a494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:14.524986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eb92c-bf53-4be1-a7f4-9eee5f2a494c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.525482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eb92c-bf53-4be1-a7f4-9eee5f2a494c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.526245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eb92c-bf53-4be1-a7f4-9eee5f2a494c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.540424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8eb92c-bf53-4be1-a7f4-9eee5f2a494c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:14.540424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8eb92c-bf53-4be1-a7f4-9eee5f2a494c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:14.542688 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-de8eb92c-bf53-4be1-a7f4-9eee5f2a494c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:14.563903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:14.565045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:14.566140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:14.566140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:14.566140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:14.566140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:14.566414 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 390/782] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:14.567511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59fd33-4546-4ba9-8a5d-42b3dcee66eb None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.567793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59fd33-4546-4ba9-8a5d-42b3dcee66eb None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.568067 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59fd33-4546-4ba9-8a5d-42b3dcee66eb None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.572362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 391/783] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:14.572362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92891839-f9d9-451f-b749-c4bb809afbd8 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.572362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92891839-f9d9-451f-b749-c4bb809afbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.572362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92891839-f9d9-451f-b749-c4bb809afbd8 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.573684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 392/784] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:14.577247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92891839-f9d9-451f-b749-c4bb809afbd8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:14.605632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb8197-8af7-4858-a189-12e858adac62 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:14.645719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1adbe5-4033-4ded-b0a8-e16f06debb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:14.646549 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1adbe5-4033-4ded-b0a8-e16f06debb6e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.646834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1adbe5-4033-4ded-b0a8-e16f06debb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.647111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1adbe5-4033-4ded-b0a8-e16f06debb6e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.655553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1adbe5-4033-4ded-b0a8-e16f06debb6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:14.656972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1adbe5-4033-4ded-b0a8-e16f06debb6e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-bc1adbe5-4033-4ded-b0a8-e16f06debb6e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:14.672305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:14.673326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:14.674316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:14.674316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:14.674316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:14.674316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:14.674316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:14.674316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:14.674316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:14.674316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:14.674316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:14.674316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:14.676742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 393/785] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 20 05:55:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:14.679222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302ebad-efb7-4a0e-aed6-1f9606778967 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.679707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302ebad-efb7-4a0e-aed6-1f9606778967 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.680203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302ebad-efb7-4a0e-aed6-1f9606778967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.687739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92891839-f9d9-451f-b749-c4bb809afbd8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:14.689403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:14.696792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3302ebad-efb7-4a0e-aed6-1f9606778967 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:14.697976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3302ebad-efb7-4a0e-aed6-1f9606778967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:14.725332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff5163-416d-4566-b276-eec09038fdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:14.725989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff5163-416d-4566-b276-eec09038fdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.726274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff5163-416d-4566-b276-eec09038fdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.726557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff5163-416d-4566-b276-eec09038fdc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.727284 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff5163-416d-4566-b276-eec09038fdc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:14.727596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff5163-416d-4566-b276-eec09038fdc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:14.728985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff5163-416d-4566-b276-eec09038fdc3 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:14.740174 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 393/786] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:14.741455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c731-b08b-468f-9fa7-1c5396333690 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.741742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c731-b08b-468f-9fa7-1c5396333690 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.742021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c731-b08b-468f-9fa7-1c5396333690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.758768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4294c731-b08b-468f-9fa7-1c5396333690 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:14.760045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4294c731-b08b-468f-9fa7-1c5396333690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:14.773018 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 394/787] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:14.785507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302ebad-efb7-4a0e-aed6-1f9606778967 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:14.833733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 394/788] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:14.833733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c731-b08b-468f-9fa7-1c5396333690 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:14.850685 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:14.907595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302ebad-efb7-4a0e-aed6-1f9606778967 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:14.930647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:14.940833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c731-b08b-468f-9fa7-1c5396333690 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:14.944196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889ce8-8f78-4b67-a10f-cfe8e0fc16c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:14.944719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889ce8-8f78-4b67-a10f-cfe8e0fc16c6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.945001 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889ce8-8f78-4b67-a10f-cfe8e0fc16c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.945273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889ce8-8f78-4b67-a10f-cfe8e0fc16c6 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.946138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00889ce8-8f78-4b67-a10f-cfe8e0fc16c6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:14.946448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00889ce8-8f78-4b67-a10f-cfe8e0fc16c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:14.947878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00889ce8-8f78-4b67-a10f-cfe8e0fc16c6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:14.970893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 395/789] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 20 05:55:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:14.970893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889ce8-8f78-4b67-a10f-cfe8e0fc16c6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:14.983574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625a210-71cd-4ecf-b4b9-c9615f18d080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:14.984556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a210-71cd-4ecf-b4b9-c9615f18d080 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:14.984844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a210-71cd-4ecf-b4b9-c9615f18d080 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:14.985168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a210-71cd-4ecf-b4b9-c9615f18d080 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:14.993466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625a210-71cd-4ecf-b4b9-c9615f18d080 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:14.994604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625a210-71cd-4ecf-b4b9-c9615f18d080 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-7625a210-71cd-4ecf-b4b9-c9615f18d080 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:15.008427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:15.009359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:15.010246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:15.010246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:15.010246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:15.010246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:15.010246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:15.010246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:15.010246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:15.010246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:15.010246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 395/790] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:15.011254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625a210-71cd-4ecf-b4b9-c9615f18d080 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:15.080791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889ce8-8f78-4b67-a10f-cfe8e0fc16c6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.083146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:15.111868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625a210-71cd-4ecf-b4b9-c9615f18d080 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.130948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68257c5a-25ca-47df-9e15-b4d8b87e5ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:15.131837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257c5a-25ca-47df-9e15-b4d8b87e5ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.132193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257c5a-25ca-47df-9e15-b4d8b87e5ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.132596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257c5a-25ca-47df-9e15-b4d8b87e5ec5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.133348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68257c5a-25ca-47df-9e15-b4d8b87e5ec5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:15.134732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68257c5a-25ca-47df-9e15-b4d8b87e5ec5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:15.145897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a14999-cfd2-4c9e-920f-36612c0d2b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:15.147293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a14999-cfd2-4c9e-920f-36612c0d2b64 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-68257c5a-25ca-47df-9e15-b4d8b87e5ec5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:15.147425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:15.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 05:55:15.154862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:15.155833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a14999-cfd2-4c9e-920f-36612c0d2b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.155833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a14999-cfd2-4c9e-920f-36612c0d2b64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.156005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 396/791] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jun 20 05:55:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:15.156005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68257c5a-25ca-47df-9e15-b4d8b87e5ec5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:15.166514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a14999-cfd2-4c9e-920f-36612c0d2b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-62a14999-cfd2-4c9e-920f-36612c0d2b64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:15.174170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:15.176024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:15.177199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:15.181989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 396/792] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:15.182824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a14999-cfd2-4c9e-920f-36612c0d2b64 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:15.199563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:15.269125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68257c5a-25ca-47df-9e15-b4d8b87e5ec5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.294198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a14999-cfd2-4c9e-920f-36612c0d2b64 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.307890 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b2b65-45d0-4bda-a63e-1781894d2fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:15.308711 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b2b65-45d0-4bda-a63e-1781894d2fee None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.308993 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b2b65-45d0-4bda-a63e-1781894d2fee None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.309268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b2b65-45d0-4bda-a63e-1781894d2fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.320668 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b2b65-45d0-4bda-a63e-1781894d2fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:15.322195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b2b65-45d0-4bda-a63e-1781894d2fee None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:15.328769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24a1e7-3d1b-4250-84e6-81e66192431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:15.329491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24a1e7-3d1b-4250-84e6-81e66192431e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.329847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24a1e7-3d1b-4250-84e6-81e66192431e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.330192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24a1e7-3d1b-4250-84e6-81e66192431e None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.331056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24a1e7-3d1b-4250-84e6-81e66192431e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:15.331365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24a1e7-3d1b-4250-84e6-81e66192431e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:15.332819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24a1e7-3d1b-4250-84e6-81e66192431e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-bc7b2b65-45d0-4bda-a63e-1781894d2fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:15.340508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:15.341521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:15.347288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:15.347288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:15.347288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:15.347288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:15.347288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 397/793] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:15.347288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b2b65-45d0-4bda-a63e-1781894d2fee None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:15.348086 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 397/794] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:15.352419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24a1e7-3d1b-4250-84e6-81e66192431e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:15.366937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:15.423595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:15.450578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b2b65-45d0-4bda-a63e-1781894d2fee None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.456267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24a1e7-3d1b-4250-84e6-81e66192431e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.491047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38142c20-65bf-47bc-8123-d3864c1a6d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:15.491712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38142c20-65bf-47bc-8123-d3864c1a6d4a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.492039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38142c20-65bf-47bc-8123-d3864c1a6d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.492345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38142c20-65bf-47bc-8123-d3864c1a6d4a None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.493052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38142c20-65bf-47bc-8123-d3864c1a6d4a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:15.493360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38142c20-65bf-47bc-8123-d3864c1a6d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:15.494188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502722d-307d-4c17-872d-57b8e6883e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:15.494734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38142c20-65bf-47bc-8123-d3864c1a6d4a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:15.495002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502722d-307d-4c17-872d-57b8e6883e1c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.495371 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502722d-307d-4c17-872d-57b8e6883e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.495699 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502722d-307d-4c17-872d-57b8e6883e1c None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.496589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502722d-307d-4c17-872d-57b8e6883e1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:15.497006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502722d-307d-4c17-872d-57b8e6883e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:15.498365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502722d-307d-4c17-872d-57b8e6883e1c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:15.499455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 398/795] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 20 05:55:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:15.504417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38142c20-65bf-47bc-8123-d3864c1a6d4a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:15.511929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 398/796] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:55:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:15.512878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502722d-307d-4c17-872d-57b8e6883e1c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:15.587911 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:15.604526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38142c20-65bf-47bc-8123-d3864c1a6d4a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.610277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502722d-307d-4c17-872d-57b8e6883e1c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.637439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60148c52-73d0-4b12-a1cc-2798b0336473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:15.638093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60148c52-73d0-4b12-a1cc-2798b0336473 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.638373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60148c52-73d0-4b12-a1cc-2798b0336473 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.638654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60148c52-73d0-4b12-a1cc-2798b0336473 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.639368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60148c52-73d0-4b12-a1cc-2798b0336473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:15.639675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60148c52-73d0-4b12-a1cc-2798b0336473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:15.641070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60148c52-73d0-4b12-a1cc-2798b0336473 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:15.643734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936e94a-5f53-4f08-97db-e0ca0825dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:15.644651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936e94a-5f53-4f08-97db-e0ca0825dffb None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.644941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936e94a-5f53-4f08-97db-e0ca0825dffb None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.645222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936e94a-5f53-4f08-97db-e0ca0825dffb None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/cbe8aea409c3459f9f7b3c3ef6ff583b/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.647206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936e94a-5f53-4f08-97db-e0ca0825dffb None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=cbe8aea409c3459f9f7b3c3ef6ff583b, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:15.649114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936e94a-5f53-4f08-97db-e0ca0825dffb None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:15.652034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:15.652901 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 399/797] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:15.653570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60148c52-73d0-4b12-a1cc-2798b0336473 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:15.666326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 399/798] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:55:15 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/cbe8aea409c3459f9f7b3c3ef6ff583b/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:55:15.667352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936e94a-5f53-4f08-97db-e0ca0825dffb None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:15.763073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60148c52-73d0-4b12-a1cc-2798b0336473 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.790747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936e94a-5f53-4f08-97db-e0ca0825dffb None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.806467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04540080-2328-4e4f-8e71-cf0f98b89513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:15.807190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04540080-2328-4e4f-8e71-cf0f98b89513 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.807706 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04540080-2328-4e4f-8e71-cf0f98b89513 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.807947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04540080-2328-4e4f-8e71-cf0f98b89513 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.808707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04540080-2328-4e4f-8e71-cf0f98b89513 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:15.809014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04540080-2328-4e4f-8e71-cf0f98b89513 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:15.810964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04540080-2328-4e4f-8e71-cf0f98b89513 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:15.820968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 400/799] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jun 20 05:55:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:15.822352 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312cfdf-6c13-4abf-bc3a-45a1d54f5f32 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.822645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312cfdf-6c13-4abf-bc3a-45a1d54f5f32 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.822922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312cfdf-6c13-4abf-bc3a-45a1d54f5f32 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.824445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 401/800] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:15.825157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312cfdf-6c13-4abf-bc3a-45a1d54f5f32 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:15.834992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b123df-4cf2-4c60-b20c-bd54bfecef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:15.835798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b123df-4cf2-4c60-b20c-bd54bfecef0c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.836086 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b123df-4cf2-4c60-b20c-bd54bfecef0c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.836443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b123df-4cf2-4c60-b20c-bd54bfecef0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.837455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:15.848160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b123df-4cf2-4c60-b20c-bd54bfecef0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:15.849682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b123df-4cf2-4c60-b20c-bd54bfecef0c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-25b123df-4cf2-4c60-b20c-bd54bfecef0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:15.867714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:15.868980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:15.870407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:15.870407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:15.870407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:15.870407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:15.870407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 400/801] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:15.870407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b123df-4cf2-4c60-b20c-bd54bfecef0c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:15.916678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:15.940477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312cfdf-6c13-4abf-bc3a-45a1d54f5f32 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.971753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b123df-4cf2-4c60-b20c-bd54bfecef0c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:15.977049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644db2ba-5de4-4aa3-928d-5f5447866845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:15.977835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644db2ba-5de4-4aa3-928d-5f5447866845 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:15.978119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644db2ba-5de4-4aa3-928d-5f5447866845 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:15.978389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644db2ba-5de4-4aa3-928d-5f5447866845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:15.985598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644db2ba-5de4-4aa3-928d-5f5447866845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:15.987189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644db2ba-5de4-4aa3-928d-5f5447866845 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-644db2ba-5de4-4aa3-928d-5f5447866845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:16.001721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:16.002625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:16.003492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:16.003492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:16.003492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:16.003492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:16.003492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:16.003492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:16.003492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:16.003492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:16.003492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 402/802] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:16.004622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762553b-3f3c-47af-94eb-f0838e00577c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:16.004622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762553b-3f3c-47af-94eb-f0838e00577c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:16.004622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762553b-3f3c-47af-94eb-f0838e00577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:16.011622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a9600-fd3b-4df9-94c8-cbde95bd95c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:16.012814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9600-fd3b-4df9-94c8-cbde95bd95c2 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:16.013372 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9600-fd3b-4df9-94c8-cbde95bd95c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:16.013837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9600-fd3b-4df9-94c8-cbde95bd95c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:16.015171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a9600-fd3b-4df9-94c8-cbde95bd95c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:16.016844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a9600-fd3b-4df9-94c8-cbde95bd95c2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:16.023567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7762553b-3f3c-47af-94eb-f0838e00577c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:16.025137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7762553b-3f3c-47af-94eb-f0838e00577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:16.038701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 401/803] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 20 05:55:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:55:16.039539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a9600-fd3b-4df9-94c8-cbde95bd95c2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:16.119929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:16.134432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 403/804] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:16.135115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762553b-3f3c-47af-94eb-f0838e00577c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:16.190273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a9600-fd3b-4df9-94c8-cbde95bd95c2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:16.191981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:16.235860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c61e0b-4dec-41f3-81bf-b91ce748603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:16.237785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c61e0b-4dec-41f3-81bf-b91ce748603c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:16.237785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c61e0b-4dec-41f3-81bf-b91ce748603c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:16.238061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c61e0b-4dec-41f3-81bf-b91ce748603c None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:16.241706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c61e0b-4dec-41f3-81bf-b91ce748603c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:16.242293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c61e0b-4dec-41f3-81bf-b91ce748603c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:16.245333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c61e0b-4dec-41f3-81bf-b91ce748603c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:16.265081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 402/805] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:16.266304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c61e0b-4dec-41f3-81bf-b91ce748603c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:16.286507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762553b-3f3c-47af-94eb-f0838e00577c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:16.331857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfccba6-93bb-480d-9e65-e4e13aa7d5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:16.332577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfccba6-93bb-480d-9e65-e4e13aa7d5ee None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:16.332863 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfccba6-93bb-480d-9e65-e4e13aa7d5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:16.333143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfccba6-93bb-480d-9e65-e4e13aa7d5ee None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:16.333941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfccba6-93bb-480d-9e65-e4e13aa7d5ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:16.334925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfccba6-93bb-480d-9e65-e4e13aa7d5ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:16.336487 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfccba6-93bb-480d-9e65-e4e13aa7d5ee None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:16.349705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 404/806] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:16.350555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfccba6-93bb-480d-9e65-e4e13aa7d5ee None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:16.377591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c61e0b-4dec-41f3-81bf-b91ce748603c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:16.414424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ccef2-87e1-4e6d-b009-878a62507335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:16.415595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccef2-87e1-4e6d-b009-878a62507335 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:16.416079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccef2-87e1-4e6d-b009-878a62507335 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:16.416548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:16.416806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccef2-87e1-4e6d-b009-878a62507335 None admin] PATH_INFO: `/v3/services/network` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:16.417655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ccef2-87e1-4e6d-b009-878a62507335 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:16.419234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ccef2-87e1-4e6d-b009-878a62507335 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-df3ccef2-87e1-4e6d-b009-878a62507335 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:16.431927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:16.432994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 05:55:16.433840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:16.436743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 403/807] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:16 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:16.437785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ccef2-87e1-4e6d-b009-878a62507335 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:16.464890 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfccba6-93bb-480d-9e65-e4e13aa7d5ee None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:16.466945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:16.501929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26addf-430d-4b0c-91df-8526098c7163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:16.502704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26addf-430d-4b0c-91df-8526098c7163 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:16.502991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26addf-430d-4b0c-91df-8526098c7163 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:16.503283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26addf-430d-4b0c-91df-8526098c7163 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:16.511632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26addf-430d-4b0c-91df-8526098c7163 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:16.513244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26addf-430d-4b0c-91df-8526098c7163 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-ea26addf-430d-4b0c-91df-8526098c7163 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:16.529122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:16.530056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:16.531406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:16.531406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:16.531406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:16.531406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:16.531406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:16.531406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:16.531406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:16.531406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:16.531406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:55:16.531406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:16.535056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 405/808] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:16.535893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26addf-430d-4b0c-91df-8526098c7163 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:16.548975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ccef2-87e1-4e6d-b009-878a62507335 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:16.584589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c93ea-10d6-41c8-a476-f565707cb3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:16.585828 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c93ea-10d6-41c8-a476-f565707cb3ec None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:16.586333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c93ea-10d6-41c8-a476-f565707cb3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:16.586815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c93ea-10d6-41c8-a476-f565707cb3ec None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/25a82cc64a424e3d87062043f24d5285/roles/3b8809a605ba4173b9b96a4ef54212a2` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:16.610997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c93ea-10d6-41c8-a476-f565707cb3ec None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=25a82cc64a424e3d87062043f24d5285, role_id=3b8809a605ba4173b9b96a4ef54212a2)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:16.612987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c93ea-10d6-41c8-a476-f565707cb3ec None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:16.633483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 404/809] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:55:16 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/25a82cc64a424e3d87062043f24d5285/roles/3b8809a605ba4173b9b96a4ef54212a2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:55:16.634756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c93ea-10d6-41c8-a476-f565707cb3ec None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:16.651776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26addf-430d-4b0c-91df-8526098c7163 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:16.670656 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:16.700591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e355cbb-155a-4a20-b73e-dcb0475f8b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:16.701442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e355cbb-155a-4a20-b73e-dcb0475f8b7e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:16.701735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e355cbb-155a-4a20-b73e-dcb0475f8b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:16.702017 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e355cbb-155a-4a20-b73e-dcb0475f8b7e None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:16.702754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e355cbb-155a-4a20-b73e-dcb0475f8b7e None admin] RBAC: Adding query filter params (name=network) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:16.703571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e355cbb-155a-4a20-b73e-dcb0475f8b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:16.705341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e355cbb-155a-4a20-b73e-dcb0475f8b7e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:16.711878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 406/810] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:16.717534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e355cbb-155a-4a20-b73e-dcb0475f8b7e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:16.746738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:16.782069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c93ea-10d6-41c8-a476-f565707cb3ec None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:16.859415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e355cbb-155a-4a20-b73e-dcb0475f8b7e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:16.892436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe122759-507b-44bc-9ce7-eb2666fdeaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:16.892436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe122759-507b-44bc-9ce7-eb2666fdeaba None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:16.892436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe122759-507b-44bc-9ce7-eb2666fdeaba None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:16.892436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe122759-507b-44bc-9ce7-eb2666fdeaba None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:16.893118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe122759-507b-44bc-9ce7-eb2666fdeaba None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:16.893444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe122759-507b-44bc-9ce7-eb2666fdeaba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:16.896232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe122759-507b-44bc-9ce7-eb2666fdeaba None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:16.901636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f059bfc-c9dd-4d43-97c4-5097073cfbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:16.902409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f059bfc-c9dd-4d43-97c4-5097073cfbfc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:16.902768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f059bfc-c9dd-4d43-97c4-5097073cfbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:16.903114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f059bfc-c9dd-4d43-97c4-5097073cfbfc None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:16.903908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f059bfc-c9dd-4d43-97c4-5097073cfbfc None admin] RBAC: Adding query filter params (type=network) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:16.904281 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f059bfc-c9dd-4d43-97c4-5097073cfbfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:16.907135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f059bfc-c9dd-4d43-97c4-5097073cfbfc None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:16.915030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 407/811] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:16.920404 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f059bfc-c9dd-4d43-97c4-5097073cfbfc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:16.923651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 405/812] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 20 05:55:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:16.929772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe122759-507b-44bc-9ce7-eb2666fdeaba None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:17.016242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:17.098824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe122759-507b-44bc-9ce7-eb2666fdeaba None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:17.135885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b97303-0b39-4ef2-81f4-aecd3b2709d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:17.136709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b97303-0b39-4ef2-81f4-aecd3b2709d8 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:17.137000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b97303-0b39-4ef2-81f4-aecd3b2709d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:17.137628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b97303-0b39-4ef2-81f4-aecd3b2709d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:17.140625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:17.153322 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b97303-0b39-4ef2-81f4-aecd3b2709d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:17.155082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b97303-0b39-4ef2-81f4-aecd3b2709d8 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:17.165488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f059bfc-c9dd-4d43-97c4-5097073cfbfc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-10b97303-0b39-4ef2-81f4-aecd3b2709d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:17.188473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:17.189429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:17.190318 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:17.190318 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:17.190318 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:17.190318 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:17.196750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 406/813] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:17.205515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b97303-0b39-4ef2-81f4-aecd3b2709d8 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:17.223666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a7e3a-547d-4599-8d66-ccf3cb61f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:17.225219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7e3a-547d-4599-8d66-ccf3cb61f3d1 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:17.225912 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7e3a-547d-4599-8d66-ccf3cb61f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:17.227243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a7e3a-547d-4599-8d66-ccf3cb61f3d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:17.228942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a7e3a-547d-4599-8d66-ccf3cb61f3d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:17.230681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a7e3a-547d-4599-8d66-ccf3cb61f3d1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:17.295513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 408/814] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 20 05:55:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:55:17.363946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b97303-0b39-4ef2-81f4-aecd3b2709d8 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:17.415156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8d31e-e782-4611-94ce-b5a41c39f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:17.415829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8d31e-e782-4611-94ce-b5a41c39f5cd None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:17.416114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8d31e-e782-4611-94ce-b5a41c39f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:17.416414 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8d31e-e782-4611-94ce-b5a41c39f5cd None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:17.417144 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8d31e-e782-4611-94ce-b5a41c39f5cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:17.417451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8d31e-e782-4611-94ce-b5a41c39f5cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:17.418829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8d31e-e782-4611-94ce-b5a41c39f5cd None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:17.431977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 407/815] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:17.437188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a7e3a-547d-4599-8d66-ccf3cb61f3d1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:17.572634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:17.576868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a7e3a-547d-4599-8d66-ccf3cb61f3d1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:17.621043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20dd77-e77a-43fd-8f2b-02ac238f0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:17.621769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dd77-e77a-43fd-8f2b-02ac238f0ffa None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:17.622049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dd77-e77a-43fd-8f2b-02ac238f0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:17.622323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dd77-e77a-43fd-8f2b-02ac238f0ffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:17.629840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20dd77-e77a-43fd-8f2b-02ac238f0ffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:17.631897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20dd77-e77a-43fd-8f2b-02ac238f0ffa None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-ab20dd77-e77a-43fd-8f2b-02ac238f0ffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:17.646166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:17.647122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:17.647996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:17.647996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:17.647996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:17.647996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:17.647996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:17.647996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:17.647996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:17.647996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:17.647996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 409/816] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:17.653735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8d31e-e782-4611-94ce-b5a41c39f5cd None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:17.700926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:17.764902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8d31e-e782-4611-94ce-b5a41c39f5cd None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:17.807819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221b20f-0795-4888-8240-ef7280ba4b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:17.808521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221b20f-0795-4888-8240-ef7280ba4b4e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:17.808808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221b20f-0795-4888-8240-ef7280ba4b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:17.809088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221b20f-0795-4888-8240-ef7280ba4b4e None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:17.809883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221b20f-0795-4888-8240-ef7280ba4b4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:17.810193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221b20f-0795-4888-8240-ef7280ba4b4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:17.811621 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221b20f-0795-4888-8240-ef7280ba4b4e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:17.827454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 408/817] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:17.833301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20dd77-e77a-43fd-8f2b-02ac238f0ffa None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:17.927154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00a8c3-97bd-4fbe-abb9-9834b4ab057a None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:17.927346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00a8c3-97bd-4fbe-abb9-9834b4ab057a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:17.928578 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00a8c3-97bd-4fbe-abb9-9834b4ab057a None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:17.933788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 409/818] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:17.935082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be875b-3a78-43dd-bca9-a2fe501e84d7 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:17.935370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be875b-3a78-43dd-bca9-a2fe501e84d7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:17.935668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be875b-3a78-43dd-bca9-a2fe501e84d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:17.953268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a6be875b-3a78-43dd-bca9-a2fe501e84d7 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:17.954455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a6be875b-3a78-43dd-bca9-a2fe501e84d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:17.955716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20dd77-e77a-43fd-8f2b-02ac238f0ffa None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:18.000383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a19a5f-d6c1-47e9-9b6f-164cc2535aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:18.001688 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a19a5f-d6c1-47e9-9b6f-164cc2535aa3 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:18.002178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a19a5f-d6c1-47e9-9b6f-164cc2535aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:18.002656 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a19a5f-d6c1-47e9-9b6f-164cc2535aa3 None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/265894b988a640f0b17846d4986b670a/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:18.005558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a19a5f-d6c1-47e9-9b6f-164cc2535aa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=265894b988a640f0b17846d4986b670a, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:18.008261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a19a5f-d6c1-47e9-9b6f-164cc2535aa3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:18.030894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 410/819] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:55:17 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/265894b988a640f0b17846d4986b670a/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:55:18.045472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 410/820] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:18.069161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a19a5f-d6c1-47e9-9b6f-164cc2535aa3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:18.097484 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:18.191382 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a19a5f-d6c1-47e9-9b6f-164cc2535aa3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:18.233146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e3ded-70ab-44a6-8e94-17922d6f7088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:18.233146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e3ded-70ab-44a6-8e94-17922d6f7088 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:18.233146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e3ded-70ab-44a6-8e94-17922d6f7088 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:18.233146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e3ded-70ab-44a6-8e94-17922d6f7088 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:18.243629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e3ded-70ab-44a6-8e94-17922d6f7088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f05e3ded-70ab-44a6-8e94-17922d6f7088 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:18.251358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:18.252284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:18.253297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 411/821] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:18.263991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be875b-3a78-43dd-bca9-a2fe501e84d7 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:18.298941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:18.371364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be875b-3a78-43dd-bca9-a2fe501e84d7 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:18.407667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dc16a-11ca-4cc5-80c6-602907006f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:18.408733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dc16a-11ca-4cc5-80c6-602907006f4a None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:18.409250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dc16a-11ca-4cc5-80c6-602907006f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:18.409739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dc16a-11ca-4cc5-80c6-602907006f4a None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:18.410679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dc16a-11ca-4cc5-80c6-602907006f4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:18.411171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dc16a-11ca-4cc5-80c6-602907006f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:18.413302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dc16a-11ca-4cc5-80c6-602907006f4a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:18.426947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 411/822] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:55:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:18.428608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e3ded-70ab-44a6-8e94-17922d6f7088 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:18.442283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af342a-af0d-4a83-a289-b64897946012 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:18.442511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af342a-af0d-4a83-a289-b64897946012 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:18.442785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af342a-af0d-4a83-a289-b64897946012 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:18.444954 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 412/823] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:18.449628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449a5b-22b9-4e3b-b136-7e5d183775c0 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:18.449918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449a5b-22b9-4e3b-b136-7e5d183775c0 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:18.450205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa449a5b-22b9-4e3b-b136-7e5d183775c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:18.468824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-aa449a5b-22b9-4e3b-b136-7e5d183775c0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:18.470023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-aa449a5b-22b9-4e3b-b136-7e5d183775c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:18.519980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:18.542141 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e3ded-70ab-44a6-8e94-17922d6f7088 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:18.552667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 413/824] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:18.575665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa449a5b-22b9-4e3b-b136-7e5d183775c0 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:18.582224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ceeda-3d39-4fd5-9097-1928d3598193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:18.583027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ceeda-3d39-4fd5-9097-1928d3598193 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:18.583309 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ceeda-3d39-4fd5-9097-1928d3598193 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:18.583585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ceeda-3d39-4fd5-9097-1928d3598193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:18.595761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ceeda-3d39-4fd5-9097-1928d3598193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:18.597438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ceeda-3d39-4fd5-9097-1928d3598193 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:18.604448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-ca4ceeda-3d39-4fd5-9097-1928d3598193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:18.615469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:18.616423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:18.617318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:18.617318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:18.617318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:18.617318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:18.621330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 412/825] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:18.622178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ceeda-3d39-4fd5-9097-1928d3598193 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:18.694215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa449a5b-22b9-4e3b-b136-7e5d183775c0 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:18.725155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ceeda-3d39-4fd5-9097-1928d3598193 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:18.732121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b389b8-5509-45f6-af0d-c590fc5d7284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:18.733260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b389b8-5509-45f6-af0d-c590fc5d7284 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:18.733750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b389b8-5509-45f6-af0d-c590fc5d7284 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:18.734279 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b389b8-5509-45f6-af0d-c590fc5d7284 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:18.735196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b389b8-5509-45f6-af0d-c590fc5d7284 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:18.737215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b389b8-5509-45f6-af0d-c590fc5d7284 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-08b389b8-5509-45f6-af0d-c590fc5d7284 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:18.750672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:18.751685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:55:18.752543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:18.754673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:18.756838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 414/826] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:55:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:18.762654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b389b8-5509-45f6-af0d-c590fc5d7284 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:18.768455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa855ab-d7ec-4330-a13f-337e3257eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:18.770063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa855ab-d7ec-4330-a13f-337e3257eeba None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:18.772026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa855ab-d7ec-4330-a13f-337e3257eeba None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:18.772407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa855ab-d7ec-4330-a13f-337e3257eeba None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:18.773213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa855ab-d7ec-4330-a13f-337e3257eeba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:18.773528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa855ab-d7ec-4330-a13f-337e3257eeba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:18.774987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa855ab-d7ec-4330-a13f-337e3257eeba None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:18.792694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 413/827] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:18.794984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa855ab-d7ec-4330-a13f-337e3257eeba None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:18.866799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:18.881733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b389b8-5509-45f6-af0d-c590fc5d7284 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:18.898405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa855ab-d7ec-4330-a13f-337e3257eeba None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:18.919670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88d3d7-22e3-4c2b-8182-59ac570bed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:18.920707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88d3d7-22e3-4c2b-8182-59ac570bed44 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:18.921261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88d3d7-22e3-4c2b-8182-59ac570bed44 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:18.921745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88d3d7-22e3-4c2b-8182-59ac570bed44 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:18.922691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88d3d7-22e3-4c2b-8182-59ac570bed44 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:18.923208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88d3d7-22e3-4c2b-8182-59ac570bed44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:18.924952 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88d3d7-22e3-4c2b-8182-59ac570bed44 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:18.931138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 415/828] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:55:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:18.936160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88d3d7-22e3-4c2b-8182-59ac570bed44 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:18.941163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef7664-10e7-4cb8-94e5-f23f984b0b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:18.941957 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef7664-10e7-4cb8-94e5-f23f984b0b00 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:18.942243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef7664-10e7-4cb8-94e5-f23f984b0b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:18.942520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef7664-10e7-4cb8-94e5-f23f984b0b00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:18.950095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef7664-10e7-4cb8-94e5-f23f984b0b00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:18.951496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef7664-10e7-4cb8-94e5-f23f984b0b00 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-31ef7664-10e7-4cb8-94e5-f23f984b0b00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:18.967551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:18.969189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:18.970124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:18.970124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:18.970124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:18.970124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:18.970124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:18.970124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:18.970124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:18.970124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:18.970124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:18.970124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:18.972559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 414/829] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 20 05:55:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:18.974193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad714b-7aef-4cc2-8116-185b31d3ef89 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:18.974938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad714b-7aef-4cc2-8116-185b31d3ef89 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:18.975230 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad714b-7aef-4cc2-8116-185b31d3ef89 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:18.976807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 415/830] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:18.981124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad714b-7aef-4cc2-8116-185b31d3ef89 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:19.030783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:19.052499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88d3d7-22e3-4c2b-8182-59ac570bed44 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:19.081711 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad714b-7aef-4cc2-8116-185b31d3ef89 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:19.092099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05cc64-d8a1-406f-be8d-a16211b14c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:19.092781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05cc64-d8a1-406f-be8d-a16211b14c2b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:19.093233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05cc64-d8a1-406f-be8d-a16211b14c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:19.093343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05cc64-d8a1-406f-be8d-a16211b14c2b None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:19.094035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05cc64-d8a1-406f-be8d-a16211b14c2b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:19.094389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05cc64-d8a1-406f-be8d-a16211b14c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:19.095752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05cc64-d8a1-406f-be8d-a16211b14c2b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:19.100358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 416/831] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:55:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:19.101471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8405-d7e6-435c-8b19-45edd1210eb7 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:19.101760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8405-d7e6-435c-8b19-45edd1210eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:19.102086 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a8405-d7e6-435c-8b19-45edd1210eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:19.121058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-364a8405-d7e6-435c-8b19-45edd1210eb7 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:19.122295 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-364a8405-d7e6-435c-8b19-45edd1210eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:19.125506 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863422d-085e-450b-b8b4-5b764f504e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:19.126698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863422d-085e-450b-b8b4-5b764f504e52 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:19.127194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863422d-085e-450b-b8b4-5b764f504e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:19.127679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863422d-085e-450b-b8b4-5b764f504e52 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:19.128806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863422d-085e-450b-b8b4-5b764f504e52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:19.129338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863422d-085e-450b-b8b4-5b764f504e52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:19.131207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863422d-085e-450b-b8b4-5b764f504e52 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:19.135632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:19.153252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 416/832] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 20 05:55:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:19.159243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863422d-085e-450b-b8b4-5b764f504e52 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:19.201503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 417/833] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:19.224229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a8405-d7e6-435c-8b19-45edd1210eb7 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:19.301740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863422d-085e-450b-b8b4-5b764f504e52 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:19.314041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:19.345721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618f4ae-a775-4ffb-835b-da020d5bc8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:19.346504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f4ae-a775-4ffb-835b-da020d5bc8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:19.346789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f4ae-a775-4ffb-835b-da020d5bc8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:19.347298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f4ae-a775-4ffb-835b-da020d5bc8f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:19.357267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a8405-d7e6-435c-8b19-45edd1210eb7 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:19.397455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb2829-c4f9-4f33-882e-b0717bd072cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:19.398329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb2829-c4f9-4f33-882e-b0717bd072cb None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:19.398615 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb2829-c4f9-4f33-882e-b0717bd072cb None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:19.399443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb2829-c4f9-4f33-882e-b0717bd072cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:19.414222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb2829-c4f9-4f33-882e-b0717bd072cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-5fcb2829-c4f9-4f33-882e-b0717bd072cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:19.424909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:19.425878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:55:19.426720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:19.432334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 418/834] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:55:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:19.432334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb2829-c4f9-4f33-882e-b0717bd072cb None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:19.434483 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618f4ae-a775-4ffb-835b-da020d5bc8f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:19.437111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618f4ae-a775-4ffb-835b-da020d5bc8f8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:19.442902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:19.563275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 417/835] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:55:19.564450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618f4ae-a775-4ffb-835b-da020d5bc8f8 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:19.576415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:19.681055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618f4ae-a775-4ffb-835b-da020d5bc8f8 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:19.686005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb2829-c4f9-4f33-882e-b0717bd072cb None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:19.724287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde5b16-f843-4093-a782-5a5b1a998866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:19.725190 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde5b16-f843-4093-a782-5a5b1a998866 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:19.725571 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde5b16-f843-4093-a782-5a5b1a998866 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:19.725946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde5b16-f843-4093-a782-5a5b1a998866 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:19.726806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde5b16-f843-4093-a782-5a5b1a998866 None admin] RBAC: Adding query filter params (name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:19.727066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31daea3f-2b55-4256-8a26-7f011d7ab403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:19.727310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde5b16-f843-4093-a782-5a5b1a998866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:19.728163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daea3f-2b55-4256-8a26-7f011d7ab403 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:19.728618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daea3f-2b55-4256-8a26-7f011d7ab403 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:19.729031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daea3f-2b55-4256-8a26-7f011d7ab403 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:19.729142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde5b16-f843-4093-a782-5a5b1a998866 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:19.740606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 419/836] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:55:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:19.745007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde5b16-f843-4093-a782-5a5b1a998866 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:19.746911 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31daea3f-2b55-4256-8a26-7f011d7ab403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:19.748619 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31daea3f-2b55-4256-8a26-7f011d7ab403 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-31daea3f-2b55-4256-8a26-7f011d7ab403 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:19.775007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:19.776233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:19.777164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:19.777164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:19.777164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:19.777164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:19.780460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 418/837] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:19.782451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31daea3f-2b55-4256-8a26-7f011d7ab403 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:19.832558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:19.861621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:19.881359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde5b16-f843-4093-a782-5a5b1a998866 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:19.916930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31daea3f-2b55-4256-8a26-7f011d7ab403 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:19.925273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd94f5-1fe6-4e2d-b9ad-3e475b84015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:19.926689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd94f5-1fe6-4e2d-b9ad-3e475b84015e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:19.927081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd94f5-1fe6-4e2d-b9ad-3e475b84015e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:19.927462 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd94f5-1fe6-4e2d-b9ad-3e475b84015e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:19.942426 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd94f5-1fe6-4e2d-b9ad-3e475b84015e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:19.945316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd94f5-1fe6-4e2d-b9ad-3e475b84015e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:19.960770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8c414-5221-45a3-9772-5189e1766707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:19.961674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8c414-5221-45a3-9772-5189e1766707 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:19.962116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8c414-5221-45a3-9772-5189e1766707 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:19.962535 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8c414-5221-45a3-9772-5189e1766707 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:19.963392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8c414-5221-45a3-9772-5189e1766707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:19.963890 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8c414-5221-45a3-9772-5189e1766707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:19.965500 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8c414-5221-45a3-9772-5189e1766707 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-40cd94f5-1fe6-4e2d-b9ad-3e475b84015e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:19.967942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:19.968982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:19.969890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:19.969890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:19.969890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:19.969890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:19.972445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 420/838] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:19.976003 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd94f5-1fe6-4e2d-b9ad-3e475b84015e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:19.986507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 419/839] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:19.992539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8c414-5221-45a3-9772-5189e1766707 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:20.080663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd94f5-1fe6-4e2d-b9ad-3e475b84015e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:20.100807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:20.103657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8c414-5221-45a3-9772-5189e1766707 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:20.116530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273c005-e99c-4223-809a-fc205a2ced97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:20.117427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273c005-e99c-4223-809a-fc205a2ced97 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:20.117540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273c005-e99c-4223-809a-fc205a2ced97 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:20.117739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273c005-e99c-4223-809a-fc205a2ced97 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:20.118463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273c005-e99c-4223-809a-fc205a2ced97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:20.118771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273c005-e99c-4223-809a-fc205a2ced97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:20.120139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273c005-e99c-4223-809a-fc205a2ced97 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:20.131216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:20.137525 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 421/840] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:20.138845 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273c005-e99c-4223-809a-fc205a2ced97 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:20.154872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015b9f-de23-403b-976e-4099ef4d6614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:20.155730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015b9f-de23-403b-976e-4099ef4d6614 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:20.156162 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015b9f-de23-403b-976e-4099ef4d6614 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:20.156600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53015b9f-de23-403b-976e-4099ef4d6614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:20.165549 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53015b9f-de23-403b-976e-4099ef4d6614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:20.167044 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53015b9f-de23-403b-976e-4099ef4d6614 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-53015b9f-de23-403b-976e-4099ef4d6614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:20.185112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:20.186016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:20.186998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:20.186998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:20.186998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:20.186998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:20.186998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:20.186998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:20.186998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:20.186998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:20.191434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 420/841] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:20.192297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015b9f-de23-403b-976e-4099ef4d6614 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:20.263212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273c005-e99c-4223-809a-fc205a2ced97 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:20.299203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe3834-4885-4509-a1a8-b8ea7054cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:20.300010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe3834-4885-4509-a1a8-b8ea7054cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:20.300289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe3834-4885-4509-a1a8-b8ea7054cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:20.300603 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe3834-4885-4509-a1a8-b8ea7054cdd2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:20.308039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe3834-4885-4509-a1a8-b8ea7054cdd2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:20.309517 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe3834-4885-4509-a1a8-b8ea7054cdd2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:20.314549 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53015b9f-de23-403b-976e-4099ef4d6614 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-9cfe3834-4885-4509-a1a8-b8ea7054cdd2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:20.324566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:20.325498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:20.326430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:20.326430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:20.326430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:20.326430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:20.326430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:20.326430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:20.326430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:20.326430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:20.326430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:20.326430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:20.326430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 422/842] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 20 05:55:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:20.327037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecb26d-f1bc-4995-aacf-e3794444ac59 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:20.327468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecb26d-f1bc-4995-aacf-e3794444ac59 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:20.327561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecb26d-f1bc-4995-aacf-e3794444ac59 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:20.328925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 423/843] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:20.335078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d3424-53fa-4b69-9a95-bbd6221238cc None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:20.335369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d3424-53fa-4b69-9a95-bbd6221238cc None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:20.335552 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d3424-53fa-4b69-9a95-bbd6221238cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:20.353288 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-823d3424-53fa-4b69-9a95-bbd6221238cc None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:20.354580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-823d3424-53fa-4b69-9a95-bbd6221238cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:20.359368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f01a6-83d3-4883-8274-5b85123af036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:20.360029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f01a6-83d3-4883-8274-5b85123af036 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:20.360344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f01a6-83d3-4883-8274-5b85123af036 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:20.360625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f01a6-83d3-4883-8274-5b85123af036 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:20.361406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f01a6-83d3-4883-8274-5b85123af036 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:20.361723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f01a6-83d3-4883-8274-5b85123af036 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:20.363153 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f01a6-83d3-4883-8274-5b85123af036 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:20.380992 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 421/844] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:20.381961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f01a6-83d3-4883-8274-5b85123af036 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:20.389204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:20.424924 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:20.425337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 424/845] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:20.426214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d3424-53fa-4b69-9a95-bbd6221238cc None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:20.501722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f01a6-83d3-4883-8274-5b85123af036 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:20.533282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d3424-53fa-4b69-9a95-bbd6221238cc None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:20.537778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c031-683e-4d96-845b-a6695238370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:20.538451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c031-683e-4d96-845b-a6695238370e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:20.538739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c031-683e-4d96-845b-a6695238370e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:20.539018 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c031-683e-4d96-845b-a6695238370e None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:20.539855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c031-683e-4d96-845b-a6695238370e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:20.540172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c031-683e-4d96-845b-a6695238370e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:20.541652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c031-683e-4d96-845b-a6695238370e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:20.560255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 422/846] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 20 05:55:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:20.561001 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c031-683e-4d96-845b-a6695238370e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:20.575860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4b9b1-273f-4baa-9d69-54bfa8ac6ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:20.576750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4b9b1-273f-4baa-9d69-54bfa8ac6ecf None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:20.577035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4b9b1-273f-4baa-9d69-54bfa8ac6ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:20.577309 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4b9b1-273f-4baa-9d69-54bfa8ac6ecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:20.578143 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4b9b1-273f-4baa-9d69-54bfa8ac6ecf None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=cbe8aea409c3459f9f7b3c3ef6ff583b) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:20.578463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4b9b1-273f-4baa-9d69-54bfa8ac6ecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:20.579899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4b9b1-273f-4baa-9d69-54bfa8ac6ecf None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:20.585838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 425/847] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:20 2022] GET /identity/v3/role_assignments?user.id=cbe8aea409c3459f9f7b3c3ef6ff583b&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:20.586605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4b9b1-273f-4baa-9d69-54bfa8ac6ecf None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:20.631852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:20.709620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4b9b1-273f-4baa-9d69-54bfa8ac6ecf None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:20.756475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f1cb8-b9b6-49f3-8900-b6fe8daffc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:20.757431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f1cb8-b9b6-49f3-8900-b6fe8daffc0c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:20.757722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f1cb8-b9b6-49f3-8900-b6fe8daffc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:20.757999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f1cb8-b9b6-49f3-8900-b6fe8daffc0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:20.810854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:20.816705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c031-683e-4d96-845b-a6695238370e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:20.853534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f1cb8-b9b6-49f3-8900-b6fe8daffc0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:20.855736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f1cb8-b9b6-49f3-8900-b6fe8daffc0c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:20.862991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5eb4e-96af-4ddb-9675-55fed22bac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:20.863763 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5eb4e-96af-4ddb-9675-55fed22bac68 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:20.864044 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5eb4e-96af-4ddb-9675-55fed22bac68 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:20.864332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5eb4e-96af-4ddb-9675-55fed22bac68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:20.878514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5eb4e-96af-4ddb-9675-55fed22bac68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-36d5eb4e-96af-4ddb-9675-55fed22bac68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:20.892189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:20.893410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:20.894461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:20.895553 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:20.897695 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 423/848] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:20.906046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5eb4e-96af-4ddb-9675-55fed22bac68 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:20.989445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 426/849] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:55:20.991012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f1cb8-b9b6-49f3-8900-b6fe8daffc0c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:21.020931 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5eb4e-96af-4ddb-9675-55fed22bac68 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:21.058452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55a832-3fa3-463b-8700-1b69d30d5c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:21.058880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55a832-3fa3-463b-8700-1b69d30d5c31 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.059170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55a832-3fa3-463b-8700-1b69d30d5c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.059447 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55a832-3fa3-463b-8700-1b69d30d5c31 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.060209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55a832-3fa3-463b-8700-1b69d30d5c31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:21.060560 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55a832-3fa3-463b-8700-1b69d30d5c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:21.061944 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55a832-3fa3-463b-8700-1b69d30d5c31 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:21.076167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 424/850] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:55:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:21.079383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55a832-3fa3-463b-8700-1b69d30d5c31 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:21.104945 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:21.137175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f1cb8-b9b6-49f3-8900-b6fe8daffc0c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:21.187130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d8add-9763-4f56-b48d-a6a303ba0e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:21.188169 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d8add-9763-4f56-b48d-a6a303ba0e57 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.188578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55a832-3fa3-463b-8700-1b69d30d5c31 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:21.188808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d8add-9763-4f56-b48d-a6a303ba0e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.189289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d8add-9763-4f56-b48d-a6a303ba0e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.192545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:21.205374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d8add-9763-4f56-b48d-a6a303ba0e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:21.207696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d8add-9763-4f56-b48d-a6a303ba0e57 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-504d8add-9763-4f56-b48d-a6a303ba0e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:21.227201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:21.228114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:21.229807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:21.229807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:21.229807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:21.229807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:21.230032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd481d-1cbb-498c-990f-8daa0685836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:21.230032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd481d-1cbb-498c-990f-8daa0685836b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.230032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd481d-1cbb-498c-990f-8daa0685836b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.230032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd481d-1cbb-498c-990f-8daa0685836b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.235812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 427/851] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:21.237238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd166b-4d81-44f3-9873-852b59d92024 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.237532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd166b-4d81-44f3-9873-852b59d92024 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.237811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd166b-4d81-44f3-9873-852b59d92024 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.239635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 428/852] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:21.242629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd481d-1cbb-498c-990f-8daa0685836b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:21.244492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd481d-1cbb-498c-990f-8daa0685836b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:21.245803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd166b-4d81-44f3-9873-852b59d92024 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-36bd481d-1cbb-498c-990f-8daa0685836b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:21.265183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:21.266154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:21.267040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:21.267040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:21.267040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:21.267040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:21.267040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 425/853] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:21.267757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b79f-02c2-42d7-8616-a68580c47b0a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.267862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b79f-02c2-42d7-8616-a68580c47b0a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.268122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b79f-02c2-42d7-8616-a68580c47b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.285283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5226b79f-02c2-42d7-8616-a68580c47b0a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:21.286585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5226b79f-02c2-42d7-8616-a68580c47b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:21.358254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 426/854] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:21.359468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226b79f-02c2-42d7-8616-a68580c47b0a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:21.362046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:21.370474 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd166b-4d81-44f3-9873-852b59d92024 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:21.411522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce603616-ab62-4caa-bcf4-70312b3735e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:21.412848 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce603616-ab62-4caa-bcf4-70312b3735e9 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.413046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce603616-ab62-4caa-bcf4-70312b3735e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.413294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce603616-ab62-4caa-bcf4-70312b3735e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.414022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce603616-ab62-4caa-bcf4-70312b3735e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:21.414333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce603616-ab62-4caa-bcf4-70312b3735e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:21.415703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce603616-ab62-4caa-bcf4-70312b3735e9 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:21.426981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 429/855] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:21.427748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce603616-ab62-4caa-bcf4-70312b3735e9 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:21.471623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226b79f-02c2-42d7-8616-a68580c47b0a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:21.478473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:21.510700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c330a85-906b-4f24-8bf8-17687f0dd1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:21.511644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330a85-906b-4f24-8bf8-17687f0dd1ac None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.511940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330a85-906b-4f24-8bf8-17687f0dd1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.512219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c330a85-906b-4f24-8bf8-17687f0dd1ac None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.512978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330a85-906b-4f24-8bf8-17687f0dd1ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:21.513370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330a85-906b-4f24-8bf8-17687f0dd1ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:21.515386 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c330a85-906b-4f24-8bf8-17687f0dd1ac None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:21.535197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 427/856] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:21.535197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c330a85-906b-4f24-8bf8-17687f0dd1ac None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:21.539755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce603616-ab62-4caa-bcf4-70312b3735e9 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:21.574765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956faaa3-41eb-4429-9c95-e67120172571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:21.575817 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956faaa3-41eb-4429-9c95-e67120172571 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.576112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956faaa3-41eb-4429-9c95-e67120172571 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.576424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956faaa3-41eb-4429-9c95-e67120172571 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.577519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956faaa3-41eb-4429-9c95-e67120172571 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:21.579206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956faaa3-41eb-4429-9c95-e67120172571 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:21.592229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 430/857] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:55:21 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:55:21.593097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956faaa3-41eb-4429-9c95-e67120172571 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:21.624832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:21.649438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c330a85-906b-4f24-8bf8-17687f0dd1ac None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:21.699078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333a32b-128e-4bde-b3fe-b336e40530ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:21.700284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a32b-128e-4bde-b3fe-b336e40530ec None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.700867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a32b-128e-4bde-b3fe-b336e40530ec None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.701328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333a32b-128e-4bde-b3fe-b336e40530ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.706073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956faaa3-41eb-4429-9c95-e67120172571 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:21.710260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333a32b-128e-4bde-b3fe-b336e40530ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:21.712120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333a32b-128e-4bde-b3fe-b336e40530ec None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:21.713909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-5333a32b-128e-4bde-b3fe-b336e40530ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:21.733250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:21.734245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:21.735148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:21.735148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:21.735148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:21.735148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:21.735148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:21.735148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:21.735148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:21.735148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:21.737679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 428/858] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:21.743584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333a32b-128e-4bde-b3fe-b336e40530ec None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:21.752685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cba9f-0364-45a3-a6b3-524de3d82dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:21.753493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cba9f-0364-45a3-a6b3-524de3d82dbf None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.753809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cba9f-0364-45a3-a6b3-524de3d82dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.754557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cba9f-0364-45a3-a6b3-524de3d82dbf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.765958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cba9f-0364-45a3-a6b3-524de3d82dbf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:21.767694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cba9f-0364-45a3-a6b3-524de3d82dbf None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-f33cba9f-0364-45a3-a6b3-524de3d82dbf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:21.785889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:21.786947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:21.787898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:21.787898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:21.787898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:21.787898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:21.787898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:21.787898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:21.787898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:21.787898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:21.787898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 05:55:21.787898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:21.787898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 431/859] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:21.798390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cba9f-0364-45a3-a6b3-524de3d82dbf None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:21.864592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333a32b-128e-4bde-b3fe-b336e40530ec None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:21.897114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:21.904568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48009173-cc23-48b7-865d-ccd53fca0590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:21.905158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009173-cc23-48b7-865d-ccd53fca0590 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.905437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009173-cc23-48b7-865d-ccd53fca0590 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.905762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48009173-cc23-48b7-865d-ccd53fca0590 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.906603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48009173-cc23-48b7-865d-ccd53fca0590 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:21.906918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48009173-cc23-48b7-865d-ccd53fca0590 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:21.908583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48009173-cc23-48b7-865d-ccd53fca0590 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:21.922033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 429/860] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:21.928002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48009173-cc23-48b7-865d-ccd53fca0590 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:21.929783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cba9f-0364-45a3-a6b3-524de3d82dbf None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:21.974619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d3ee2-0524-487e-8c4b-64a76fcdebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:21.975569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d3ee2-0524-487e-8c4b-64a76fcdebe2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:21.975997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d3ee2-0524-487e-8c4b-64a76fcdebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:21.976443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d3ee2-0524-487e-8c4b-64a76fcdebe2 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:21.977450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d3ee2-0524-487e-8c4b-64a76fcdebe2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:21.977916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d3ee2-0524-487e-8c4b-64a76fcdebe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:21.979998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d3ee2-0524-487e-8c4b-64a76fcdebe2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:22.001077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 432/861] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jun 20 05:55:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:22.006223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d3ee2-0524-487e-8c4b-64a76fcdebe2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:22.041186 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:22.061552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48009173-cc23-48b7-865d-ccd53fca0590 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:22.104730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c58cac-e886-4a9e-aaf2-3c590379f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:22.105496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58cac-e886-4a9e-aaf2-3c590379f523 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:22.105843 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58cac-e886-4a9e-aaf2-3c590379f523 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:22.106187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58cac-e886-4a9e-aaf2-3c590379f523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:22.107084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c58cac-e886-4a9e-aaf2-3c590379f523 None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=25a82cc64a424e3d87062043f24d5285) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:22.107464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c58cac-e886-4a9e-aaf2-3c590379f523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:22.109442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c58cac-e886-4a9e-aaf2-3c590379f523 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:22.118162 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 430/862] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:21 2022] GET /identity/v3/role_assignments?user.id=25a82cc64a424e3d87062043f24d5285&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:22.145258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d3ee2-0524-487e-8c4b-64a76fcdebe2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:22.186214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4d12b-b37a-4b88-ad84-7293d8f0d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:22.186942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4d12b-b37a-4b88-ad84-7293d8f0d739 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:22.187238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4d12b-b37a-4b88-ad84-7293d8f0d739 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:22.187516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4d12b-b37a-4b88-ad84-7293d8f0d739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:22.265123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4d12b-b37a-4b88-ad84-7293d8f0d739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:22.266527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4d12b-b37a-4b88-ad84-7293d8f0d739 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:22.294983 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:22.376288 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 433/863] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:22 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:55:22.382180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c58cac-e886-4a9e-aaf2-3c590379f523 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:22.426643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:22.485453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c58cac-e886-4a9e-aaf2-3c590379f523 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:22.521251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22822ec-6315-4954-9d24-4c660d8a4e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:22.521980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22822ec-6315-4954-9d24-4c660d8a4e4d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:22.522269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22822ec-6315-4954-9d24-4c660d8a4e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:22.522548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22822ec-6315-4954-9d24-4c660d8a4e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:22.533852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22822ec-6315-4954-9d24-4c660d8a4e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:22.535318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22822ec-6315-4954-9d24-4c660d8a4e4d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f22822ec-6315-4954-9d24-4c660d8a4e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:22.552980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:22.553858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:22.554747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:22.554747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:22.554747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:22.554747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:22.554747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 431/864] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:22.559833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4d12b-b37a-4b88-ad84-7293d8f0d739 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:22.669616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4d12b-b37a-4b88-ad84-7293d8f0d739 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:22.694230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:22.706621 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509644d4-4fee-436e-8b6d-91e2599fe421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:22.707287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509644d4-4fee-436e-8b6d-91e2599fe421 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:22.707573 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509644d4-4fee-436e-8b6d-91e2599fe421 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:22.707851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509644d4-4fee-436e-8b6d-91e2599fe421 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:22.708607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509644d4-4fee-436e-8b6d-91e2599fe421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:22.709454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509644d4-4fee-436e-8b6d-91e2599fe421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:22.710838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509644d4-4fee-436e-8b6d-91e2599fe421 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:22.723045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 434/865] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:22.729387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22822ec-6315-4954-9d24-4c660d8a4e4d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:22.778417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d6d4-93db-410c-8469-cf9378521b48 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:22.778709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d6d4-93db-410c-8469-cf9378521b48 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:22.778896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d6d4-93db-410c-8469-cf9378521b48 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:22.781824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 435/866] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:22.786460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164299-8b05-480e-8d4c-6664da4bab8d None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:22.786738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164299-8b05-480e-8d4c-6664da4bab8d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:22.787057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b164299-8b05-480e-8d4c-6664da4bab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:22.804662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-5b164299-8b05-480e-8d4c-6664da4bab8d None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:22.805863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5b164299-8b05-480e-8d4c-6664da4bab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:22.847139 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:22.855903 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22822ec-6315-4954-9d24-4c660d8a4e4d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:22.884803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 436/867] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:22 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:22.895448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d29b6-58b3-4d15-bbd2-d38719951a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:22.896277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d29b6-58b3-4d15-bbd2-d38719951a5f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:22.896591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d29b6-58b3-4d15-bbd2-d38719951a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:22.896871 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d29b6-58b3-4d15-bbd2-d38719951a5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:22.904051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d29b6-58b3-4d15-bbd2-d38719951a5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:22.905269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b164299-8b05-480e-8d4c-6664da4bab8d None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:22.905531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d29b6-58b3-4d15-bbd2-d38719951a5f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-2d0d29b6-58b3-4d15-bbd2-d38719951a5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:22.925029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:22.927061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:22.928999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:22.928999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:22.928999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:22.928999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:22.928999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:22.928999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:22.928999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:22.928999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:22.928999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 432/868] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:22.932578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d29b6-58b3-4d15-bbd2-d38719951a5f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:23.014229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b164299-8b05-480e-8d4c-6664da4bab8d None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:23.029545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:23.053661 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12d732-057f-4264-a2f1-c80386c18afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:23.054481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12d732-057f-4264-a2f1-c80386c18afa None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:23.054768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12d732-057f-4264-a2f1-c80386c18afa None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:23.055046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12d732-057f-4264-a2f1-c80386c18afa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:23.055710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12d732-057f-4264-a2f1-c80386c18afa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:23.056653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d29b6-58b3-4d15-bbd2-d38719951a5f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:23.057131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12d732-057f-4264-a2f1-c80386c18afa None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-3f12d732-057f-4264-a2f1-c80386c18afa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:23.070576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:23.071800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:55:23.073724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:23.080409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 437/869] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jun 20 05:55:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:23.080409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12d732-057f-4264-a2f1-c80386c18afa None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:23.095941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0497e-f111-4401-98ab-f678e88d6a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:23.096633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0497e-f111-4401-98ab-f678e88d6a30 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:23.096919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0497e-f111-4401-98ab-f678e88d6a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:23.097197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0497e-f111-4401-98ab-f678e88d6a30 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:23.098435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0497e-f111-4401-98ab-f678e88d6a30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:23.098753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0497e-f111-4401-98ab-f678e88d6a30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:23.101163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0497e-f111-4401-98ab-f678e88d6a30 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:23.117466 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 433/870] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:23.124352 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0497e-f111-4401-98ab-f678e88d6a30 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:23.144717 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:23.203942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12d732-057f-4264-a2f1-c80386c18afa None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:23.246583 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8ef4-f488-4a27-b055-b6ec2fd9e7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:23.247389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8ef4-f488-4a27-b055-b6ec2fd9e7bd None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:23.247814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8ef4-f488-4a27-b055-b6ec2fd9e7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:23.248195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f8ef4-f488-4a27-b055-b6ec2fd9e7bd None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:23.249147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f8ef4-f488-4a27-b055-b6ec2fd9e7bd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:23.249564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f8ef4-f488-4a27-b055-b6ec2fd9e7bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:23.251154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f8ef4-f488-4a27-b055-b6ec2fd9e7bd None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:23.253862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0497e-f111-4401-98ab-f678e88d6a30 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:23.256932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 438/871] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 20 05:55:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:23.265878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8ef4-f488-4a27-b055-b6ec2fd9e7bd None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:23.294745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bb7ed-8970-48ef-a588-32ec3b663192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:23.296211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb7ed-8970-48ef-a588-32ec3b663192 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:23.296837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb7ed-8970-48ef-a588-32ec3b663192 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:23.297369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb7ed-8970-48ef-a588-32ec3b663192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:23.298632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bb7ed-8970-48ef-a588-32ec3b663192 None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=265894b988a640f0b17846d4986b670a) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:23.299726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bb7ed-8970-48ef-a588-32ec3b663192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:23.302332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bb7ed-8970-48ef-a588-32ec3b663192 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:23.311061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 434/872] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:23 2022] GET /identity/v3/role_assignments?user.id=265894b988a640f0b17846d4986b670a&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:23.328346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:23.392652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f8ef4-f488-4a27-b055-b6ec2fd9e7bd None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:23.433352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dce77f-147f-418b-a44b-e70000ae01e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:23.434057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dce77f-147f-418b-a44b-e70000ae01e1 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:23.434337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dce77f-147f-418b-a44b-e70000ae01e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:23.434621 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dce77f-147f-418b-a44b-e70000ae01e1 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:23.435378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dce77f-147f-418b-a44b-e70000ae01e1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:23.435693 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dce77f-147f-418b-a44b-e70000ae01e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:23.437149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dce77f-147f-418b-a44b-e70000ae01e1 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:23.448496 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 439/873] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 20 05:55:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:23.768708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ca57b-6658-4f27-bace-ae6c66559135 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:23.769226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ca57b-6658-4f27-bace-ae6c66559135 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:23.769623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ca57b-6658-4f27-bace-ae6c66559135 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:23.771898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 435/874] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:23.777507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eeebac-30e5-42c1-8153-214f9f75e649 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:23.777974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eeebac-30e5-42c1-8153-214f9f75e649 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:23.778270 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eeebac-30e5-42c1-8153-214f9f75e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:23.795469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-90eeebac-30e5-42c1-8153-214f9f75e649 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:23.796754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-90eeebac-30e5-42c1-8153-214f9f75e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:23.869084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 440/875] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:23.892059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ca57b-6658-4f27-bace-ae6c66559135 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:23.984237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:24.013714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ca57b-6658-4f27-bace-ae6c66559135 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:24.049785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a0f4d-38fd-41c7-9f35-dec2781e7aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:24.050500 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0f4d-38fd-41c7-9f35-dec2781e7aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:24.050780 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0f4d-38fd-41c7-9f35-dec2781e7aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:24.051058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0f4d-38fd-41c7-9f35-dec2781e7aa1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:24.051716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a0f4d-38fd-41c7-9f35-dec2781e7aa1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:24.053650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a0f4d-38fd-41c7-9f35-dec2781e7aa1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-3e6a0f4d-38fd-41c7-9f35-dec2781e7aa1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:24.065690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:24.066663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:24.067958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 436/876] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:55:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:24.073011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eeebac-30e5-42c1-8153-214f9f75e649 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:24.108545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:24.176974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eeebac-30e5-42c1-8153-214f9f75e649 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:24.212461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b0915-3766-4cd7-9e99-8f78f187bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:24.213133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b0915-3766-4cd7-9e99-8f78f187bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:24.213415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b0915-3766-4cd7-9e99-8f78f187bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:24.213695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b0915-3766-4cd7-9e99-8f78f187bbb0 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:24.214417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b0915-3766-4cd7-9e99-8f78f187bbb0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:24.214724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b0915-3766-4cd7-9e99-8f78f187bbb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:24.216100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b0915-3766-4cd7-9e99-8f78f187bbb0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:24.221378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 441/877] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:55:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:24.227248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a0f4d-38fd-41c7-9f35-dec2781e7aa1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:24.345317 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a0f4d-38fd-41c7-9f35-dec2781e7aa1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:24.349992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641ebb-db02-4ca8-a36f-965675fb1e9d None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:24.350284 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641ebb-db02-4ca8-a36f-965675fb1e9d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:24.350565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45641ebb-db02-4ca8-a36f-965675fb1e9d None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:24.352050 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 442/878] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:24.357468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b28961-bde6-4d51-91a0-1b881cfbb791 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:24.357756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b28961-bde6-4d51-91a0-1b881cfbb791 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:24.358031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b28961-bde6-4d51-91a0-1b881cfbb791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:24.377475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a2b28961-bde6-4d51-91a0-1b881cfbb791 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:24.379608 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a2b28961-bde6-4d51-91a0-1b881cfbb791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:24.386494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4877-eeff-4489-8e7a-3c36ae2e6533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:24.387160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4877-eeff-4489-8e7a-3c36ae2e6533 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:24.387447 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4877-eeff-4489-8e7a-3c36ae2e6533 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:24.387727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4877-eeff-4489-8e7a-3c36ae2e6533 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:24.388467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee4877-eeff-4489-8e7a-3c36ae2e6533 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:24.388781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee4877-eeff-4489-8e7a-3c36ae2e6533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:24.390268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee4877-eeff-4489-8e7a-3c36ae2e6533 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:24.395861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 437/879] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:55:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:24.401989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4877-eeff-4489-8e7a-3c36ae2e6533 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:24.413267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:24.459560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 443/880] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:24.483274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b28961-bde6-4d51-91a0-1b881cfbb791 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:24.515285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4877-eeff-4489-8e7a-3c36ae2e6533 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:24.515616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:24.556967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050542fb-2eea-4530-9272-7fff0711c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:24.557917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050542fb-2eea-4530-9272-7fff0711c36e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:24.558406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050542fb-2eea-4530-9272-7fff0711c36e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:24.558936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050542fb-2eea-4530-9272-7fff0711c36e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:24.559886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050542fb-2eea-4530-9272-7fff0711c36e None admin] RBAC: Adding query filter params (interface=public, service_id=f8694640cc764aa79cd85ffe9d03ed95, region_id=RegionOne) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:24.560395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050542fb-2eea-4530-9272-7fff0711c36e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:24.561926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050542fb-2eea-4530-9272-7fff0711c36e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:24.572306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 438/881] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 20 05:55:24 2022] GET /identity/v3/endpoints?service_id=f8694640cc764aa79cd85ffe9d03ed95&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:24.573336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050542fb-2eea-4530-9272-7fff0711c36e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:24.590000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b28961-bde6-4d51-91a0-1b881cfbb791 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:24.627671 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe55c3-8eda-4988-af21-4238e871d06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:24.628938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe55c3-8eda-4988-af21-4238e871d06c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:24.629222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe55c3-8eda-4988-af21-4238e871d06c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:24.629497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe55c3-8eda-4988-af21-4238e871d06c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:24.648198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe55c3-8eda-4988-af21-4238e871d06c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-cffe55c3-8eda-4988-af21-4238e871d06c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:24.656991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:24.658005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:24.658855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 444/882] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 20 05:55:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:24.664898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:24.665263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe55c3-8eda-4988-af21-4238e871d06c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:24.706496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050542fb-2eea-4530-9272-7fff0711c36e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:24.750951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27217fc-6d77-4cc4-91ec-101e14c263b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:24.752369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27217fc-6d77-4cc4-91ec-101e14c263b0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:24.752821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27217fc-6d77-4cc4-91ec-101e14c263b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:24.753252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27217fc-6d77-4cc4-91ec-101e14c263b0 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:24.754545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27217fc-6d77-4cc4-91ec-101e14c263b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:24.756833 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27217fc-6d77-4cc4-91ec-101e14c263b0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:24.764513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 439/883] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 20 05:55:24 2022] GET /identity/v3/services => generated 1011 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:55:24.767803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:24.783465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe55c3-8eda-4988-af21-4238e871d06c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:24.821795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15da79-6df8-4923-85ed-361122ba5743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:24.822551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15da79-6df8-4923-85ed-361122ba5743 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:24.822836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15da79-6df8-4923-85ed-361122ba5743 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:24.823112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15da79-6df8-4923-85ed-361122ba5743 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:24.823934 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15da79-6df8-4923-85ed-361122ba5743 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:24.824250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15da79-6df8-4923-85ed-361122ba5743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:24.825679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15da79-6df8-4923-85ed-361122ba5743 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:24.836168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 445/884] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 20 05:55:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:24.841847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27217fc-6d77-4cc4-91ec-101e14c263b0 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:24.950749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27217fc-6d77-4cc4-91ec-101e14c263b0 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:24.986802 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03119a-eff1-46d8-b6a3-98db07618977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:24.987601 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03119a-eff1-46d8-b6a3-98db07618977 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:24.987888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03119a-eff1-46d8-b6a3-98db07618977 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:24.988166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03119a-eff1-46d8-b6a3-98db07618977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:24.990161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:25.000681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03119a-eff1-46d8-b6a3-98db07618977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:25.002206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03119a-eff1-46d8-b6a3-98db07618977 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-6d03119a-eff1-46d8-b6a3-98db07618977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:25.020023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:25.020971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:25.022493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:25.022493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:25.022493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:25.022493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:25.022493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 440/885] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:25.027842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15da79-6df8-4923-85ed-361122ba5743 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:25.131696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15da79-6df8-4923-85ed-361122ba5743 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:25.166733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee293918-7470-4ae0-87e8-54eef9a59505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:25.167397 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee293918-7470-4ae0-87e8-54eef9a59505 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:25.167684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee293918-7470-4ae0-87e8-54eef9a59505 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:25.167960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee293918-7470-4ae0-87e8-54eef9a59505 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:25.168720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee293918-7470-4ae0-87e8-54eef9a59505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:25.169035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee293918-7470-4ae0-87e8-54eef9a59505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:25.170405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee293918-7470-4ae0-87e8-54eef9a59505 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:25.182712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 446/886] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:25.188073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03119a-eff1-46d8-b6a3-98db07618977 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:25.294629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03119a-eff1-46d8-b6a3-98db07618977 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:25.330244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b668c-3059-4fe2-b448-00a0e441d8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:25.331061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b668c-3059-4fe2-b448-00a0e441d8cd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:25.331342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b668c-3059-4fe2-b448-00a0e441d8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:25.331619 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b668c-3059-4fe2-b448-00a0e441d8cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:25.340207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b668c-3059-4fe2-b448-00a0e441d8cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:25.341719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b668c-3059-4fe2-b448-00a0e441d8cd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-dd7b668c-3059-4fe2-b448-00a0e441d8cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:25.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:25.357686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:25.358634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:25.358634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:25.358634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:25.358634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:25.358634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:25.358634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:25.358634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:25.358634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:25.358634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:25.358634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:25.358634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 441/887] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 20 05:55:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:25.363878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee293918-7470-4ae0-87e8-54eef9a59505 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:25.379139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:25.467691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee293918-7470-4ae0-87e8-54eef9a59505 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:25.482238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6138a-e54a-4111-9b41-3c8b9d7f1b18 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:25.482536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6138a-e54a-4111-9b41-3c8b9d7f1b18 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:25.482804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6138a-e54a-4111-9b41-3c8b9d7f1b18 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:25.485130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 442/888] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:25.492527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b3d7-20a9-4ca7-8976-15cb78abe169 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:25.493055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b3d7-20a9-4ca7-8976-15cb78abe169 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:25.493556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b3d7-20a9-4ca7-8976-15cb78abe169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:25.512151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7443b3d7-20a9-4ca7-8976-15cb78abe169 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:25.512929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641348a-ae54-4147-bff8-69e35afb1703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:25.513610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641348a-ae54-4147-bff8-69e35afb1703 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:25.513894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641348a-ae54-4147-bff8-69e35afb1703 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:25.514171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641348a-ae54-4147-bff8-69e35afb1703 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:25.514701 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7443b3d7-20a9-4ca7-8976-15cb78abe169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:25.515017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641348a-ae54-4147-bff8-69e35afb1703 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:25.515330 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641348a-ae54-4147-bff8-69e35afb1703 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:25.516796 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641348a-ae54-4147-bff8-69e35afb1703 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:25.540939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 447/889] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 20 05:55:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:25.546333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641348a-ae54-4147-bff8-69e35afb1703 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:25.565177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:25.600428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 443/890] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:25 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:25.608488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fdadd-91c3-427a-9da6-991c4369b705 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:25.609015 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fdadd-91c3-427a-9da6-991c4369b705 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:25.609501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fdadd-91c3-427a-9da6-991c4369b705 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:25.611343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 444/891] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:25.616418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa0f67-6a55-49a5-9bb1-63f8bf0aef88 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:25.616939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa0f67-6a55-49a5-9bb1-63f8bf0aef88 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:25.617425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa0f67-6a55-49a5-9bb1-63f8bf0aef88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:25.621361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:25.634571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-89fa0f67-6a55-49a5-9bb1-63f8bf0aef88 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:25.635772 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-89fa0f67-6a55-49a5-9bb1-63f8bf0aef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:25.654105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641348a-ae54-4147-bff8-69e35afb1703 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:25.694935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe84da-9ae5-4bdb-a3e7-1bf1de250d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:25.695717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe84da-9ae5-4bdb-a3e7-1bf1de250d87 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:25.696009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe84da-9ae5-4bdb-a3e7-1bf1de250d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:25.696291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe84da-9ae5-4bdb-a3e7-1bf1de250d87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:25.709340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 445/892] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:25 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:25.709340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa0f67-6a55-49a5-9bb1-63f8bf0aef88 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:25.772002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe84da-9ae5-4bdb-a3e7-1bf1de250d87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:25.773428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe84da-9ae5-4bdb-a3e7-1bf1de250d87 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:25.823448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa0f67-6a55-49a5-9bb1-63f8bf0aef88 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:25.831312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:25.841750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:25.861786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab25ca-ab3f-4a22-84d5-41ec97765f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:25.862824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab25ca-ab3f-4a22-84d5-41ec97765f9c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:25.863275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab25ca-ab3f-4a22-84d5-41ec97765f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:25.863753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab25ca-ab3f-4a22-84d5-41ec97765f9c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:25.864707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab25ca-ab3f-4a22-84d5-41ec97765f9c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:25.866856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab25ca-ab3f-4a22-84d5-41ec97765f9c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:25.873767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 448/893] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:25 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:55:25.874570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe84da-9ae5-4bdb-a3e7-1bf1de250d87 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-aaab25ca-ab3f-4a22-84d5-41ec97765f9c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:25.881501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:25.882722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:25.883754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:25.886081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 446/894] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 20 05:55:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:25.887116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab25ca-ab3f-4a22-84d5-41ec97765f9c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:25.989425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe84da-9ae5-4bdb-a3e7-1bf1de250d87 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:26.001365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab25ca-ab3f-4a22-84d5-41ec97765f9c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:26.024103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed1dc-6fb9-4997-85b8-ab67747f24f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:26.024719 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed1dc-6fb9-4997-85b8-ab67747f24f2 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:26.025007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed1dc-6fb9-4997-85b8-ab67747f24f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:26.025288 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ed1dc-6fb9-4997-85b8-ab67747f24f2 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:26.026280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ed1dc-6fb9-4997-85b8-ab67747f24f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:26.027652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ed1dc-6fb9-4997-85b8-ab67747f24f2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:26.039954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f29db-e9f2-42bb-a02c-0b0825c1eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:26.040930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f29db-e9f2-42bb-a02c-0b0825c1eec1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:26.041215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f29db-e9f2-42bb-a02c-0b0825c1eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:26.041609 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f29db-e9f2-42bb-a02c-0b0825c1eec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:26.053175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 449/895] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:55:25 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:55:26.053175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed1dc-6fb9-4997-85b8-ab67747f24f2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:26.054014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f29db-e9f2-42bb-a02c-0b0825c1eec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:26.055499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f29db-e9f2-42bb-a02c-0b0825c1eec1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-d32f29db-e9f2-42bb-a02c-0b0825c1eec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:26.074068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:26.075037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:26.075926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:26.075926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:26.075926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:26.075926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:26.075926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 447/896] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:26.081418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f29db-e9f2-42bb-a02c-0b0825c1eec1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:26.106710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:26.112866 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:26.212005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ed1dc-6fb9-4997-85b8-ab67747f24f2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:26.215905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f29db-e9f2-42bb-a02c-0b0825c1eec1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:26.261975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a4651-76d6-4e0d-8dd9-ee567097e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:26.262638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a4651-76d6-4e0d-8dd9-ee567097e810 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:26.262925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a4651-76d6-4e0d-8dd9-ee567097e810 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:26.263193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a4651-76d6-4e0d-8dd9-ee567097e810 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:26.263910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a4651-76d6-4e0d-8dd9-ee567097e810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:26.264210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a4651-76d6-4e0d-8dd9-ee567097e810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:26.265619 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a4651-76d6-4e0d-8dd9-ee567097e810 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:26.269084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd722b2-4caa-48a3-b938-54c761242033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:26.269830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd722b2-4caa-48a3-b938-54c761242033 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:26.270119 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd722b2-4caa-48a3-b938-54c761242033 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:26.270396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd722b2-4caa-48a3-b938-54c761242033 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:26.271672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd722b2-4caa-48a3-b938-54c761242033 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:26.271982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd722b2-4caa-48a3-b938-54c761242033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:26.274001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd722b2-4caa-48a3-b938-54c761242033 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:26.280135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 448/897] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:26.284456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 450/898] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 20 05:55:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:26.285815 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a4651-76d6-4e0d-8dd9-ee567097e810 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:26.288334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd722b2-4caa-48a3-b938-54c761242033 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:26.371200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:26.391587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a4651-76d6-4e0d-8dd9-ee567097e810 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:26.392943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:26.404162 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd722b2-4caa-48a3-b938-54c761242033 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:26.426974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ed7a0-623f-48a2-ab19-78812e7453de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:26.428185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ed7a0-623f-48a2-ab19-78812e7453de None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:26.428508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ed7a0-623f-48a2-ab19-78812e7453de None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:26.428782 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ed7a0-623f-48a2-ab19-78812e7453de None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:26.429495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ed7a0-623f-48a2-ab19-78812e7453de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:26.429805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ed7a0-623f-48a2-ab19-78812e7453de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:26.431184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ed7a0-623f-48a2-ab19-78812e7453de None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:26.436302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 449/899] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 20 05:55:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:26.444708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca0a8b-6c56-4203-a70c-3b52fcb0c6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:26.445586 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca0a8b-6c56-4203-a70c-3b52fcb0c6ab None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:26.445874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca0a8b-6c56-4203-a70c-3b52fcb0c6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:26.446154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca0a8b-6c56-4203-a70c-3b52fcb0c6ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:26.454560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca0a8b-6c56-4203-a70c-3b52fcb0c6ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:26.456063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca0a8b-6c56-4203-a70c-3b52fcb0c6ab None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-14ca0a8b-6c56-4203-a70c-3b52fcb0c6ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:26.472740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:26.473704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:26.474664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:26.474664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:26.474664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:26.474664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:26.474664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:26.474664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:26.474664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:26.474664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:26.474664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 451/900] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:26.480431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ed7a0-623f-48a2-ab19-78812e7453de None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:26.593133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ed7a0-623f-48a2-ab19-78812e7453de None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:26.627458 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4da7de-8b26-4ad6-9f0b-7854a7ce0db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:26.628123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4da7de-8b26-4ad6-9f0b-7854a7ce0db9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:26.628425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4da7de-8b26-4ad6-9f0b-7854a7ce0db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:26.628702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4da7de-8b26-4ad6-9f0b-7854a7ce0db9 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:26.629493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4da7de-8b26-4ad6-9f0b-7854a7ce0db9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:26.629804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4da7de-8b26-4ad6-9f0b-7854a7ce0db9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:26.631292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4da7de-8b26-4ad6-9f0b-7854a7ce0db9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:26.643413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 450/901] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:26.649342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca0a8b-6c56-4203-a70c-3b52fcb0c6ab None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:26.753808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca0a8b-6c56-4203-a70c-3b52fcb0c6ab None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:26.790634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34412283-29bb-46b3-94aa-34cdafb794e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:26.791297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412283-29bb-46b3-94aa-34cdafb794e4 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:26.791580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412283-29bb-46b3-94aa-34cdafb794e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:26.791858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412283-29bb-46b3-94aa-34cdafb794e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:26.792723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34412283-29bb-46b3-94aa-34cdafb794e4 None admin] RBAC: Adding query filter params (role.id=74cbcc96b8814e84a977b222c3575a05, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=25a82cc64a424e3d87062043f24d5285) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:26.793037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34412283-29bb-46b3-94aa-34cdafb794e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:26.794479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34412283-29bb-46b3-94aa-34cdafb794e4 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:26.800762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 452/902] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:26 2022] GET /identity/v3/role_assignments?user.id=25a82cc64a424e3d87062043f24d5285&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=74cbcc96b8814e84a977b222c3575a05 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:26.901794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593236f-e374-44a4-a352-96b8a6a7bf56 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:26.902137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593236f-e374-44a4-a352-96b8a6a7bf56 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:26.902323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593236f-e374-44a4-a352-96b8a6a7bf56 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:26.903988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 451/903] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:26.909224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f7fb-c64f-43f5-9287-792c798ca34f None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:26.910165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f7fb-c64f-43f5-9287-792c798ca34f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:26.910645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f7fb-c64f-43f5-9287-792c798ca34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:26.929461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-1da0f7fb-c64f-43f5-9287-792c798ca34f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:26.931284 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1da0f7fb-c64f-43f5-9287-792c798ca34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:26.942772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:27.014708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 453/904] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:27.038181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593236f-e374-44a4-a352-96b8a6a7bf56 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:27.049127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:27.143169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593236f-e374-44a4-a352-96b8a6a7bf56 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:27.178744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c55c0-f4c7-4c66-904b-762132a61969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:27.179456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c55c0-f4c7-4c66-904b-762132a61969 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:27.179732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c55c0-f4c7-4c66-904b-762132a61969 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:27.179999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c55c0-f4c7-4c66-904b-762132a61969 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:27.180670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c55c0-f4c7-4c66-904b-762132a61969 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:27.182023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c55c0-f4c7-4c66-904b-762132a61969 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f23c55c0-f4c7-4c66-904b-762132a61969 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:27.193956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:27.194984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:27.196241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 452/905] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:55:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:27.201746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0f7fb-c64f-43f5-9287-792c798ca34f None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:27.316185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0f7fb-c64f-43f5-9287-792c798ca34f None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:27.351157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71679b-5c13-490d-9ada-e409f4d42cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:27.351821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71679b-5c13-490d-9ada-e409f4d42cef None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:27.352148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71679b-5c13-490d-9ada-e409f4d42cef None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:27.352451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71679b-5c13-490d-9ada-e409f4d42cef None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:27.353165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71679b-5c13-490d-9ada-e409f4d42cef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:27.353471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71679b-5c13-490d-9ada-e409f4d42cef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:27.354841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec71679b-5c13-490d-9ada-e409f4d42cef None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:27.360181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 454/906] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:55:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:27.365775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c55c0-f4c7-4c66-904b-762132a61969 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:27.435224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:27.466348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c55c0-f4c7-4c66-904b-762132a61969 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:27.500193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df002790-d398-4e13-aceb-53e7b5d195d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:27.500887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002790-d398-4e13-aceb-53e7b5d195d6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:27.501311 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002790-d398-4e13-aceb-53e7b5d195d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:27.501583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df002790-d398-4e13-aceb-53e7b5d195d6 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:27.502447 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df002790-d398-4e13-aceb-53e7b5d195d6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:27.502756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df002790-d398-4e13-aceb-53e7b5d195d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:27.504109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df002790-d398-4e13-aceb-53e7b5d195d6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:27.509942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 453/907] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jun 20 05:55:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:27.515424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71679b-5c13-490d-9ada-e409f4d42cef None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:27.527962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:27.634494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71679b-5c13-490d-9ada-e409f4d42cef None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:27.671695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fa54f-8368-40e2-9253-96b2a3ffd096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:27.672744 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fa54f-8368-40e2-9253-96b2a3ffd096 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:27.673297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fa54f-8368-40e2-9253-96b2a3ffd096 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:27.673781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fa54f-8368-40e2-9253-96b2a3ffd096 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:27.674754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fa54f-8368-40e2-9253-96b2a3ffd096 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:27.676344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fa54f-8368-40e2-9253-96b2a3ffd096 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:27.698423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 455/908] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 20 05:55:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:55:28.184243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcbb38-acc1-497a-af22-44fbad71e748 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:28.184647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcbb38-acc1-497a-af22-44fbad71e748 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:28.184861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcbb38-acc1-497a-af22-44fbad71e748 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:28.186433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 454/909] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:28.191633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0db0c5-e026-4f72-b96f-1fbd52ec0ecd None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:28.192087 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0db0c5-e026-4f72-b96f-1fbd52ec0ecd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:28.192273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0db0c5-e026-4f72-b96f-1fbd52ec0ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:28.209751 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4e0db0c5-e026-4f72-b96f-1fbd52ec0ecd None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:28.210939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4e0db0c5-e026-4f72-b96f-1fbd52ec0ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:28.275317 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:28.291087 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 456/910] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:28.314791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcbb38-acc1-497a-af22-44fbad71e748 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:28.420031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcbb38-acc1-497a-af22-44fbad71e748 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:28.454395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48533194-56e9-4a47-b45a-f2f173fcd933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:28.455123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48533194-56e9-4a47-b45a-f2f173fcd933 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:28.455402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48533194-56e9-4a47-b45a-f2f173fcd933 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:28.455673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48533194-56e9-4a47-b45a-f2f173fcd933 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:28.456347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48533194-56e9-4a47-b45a-f2f173fcd933 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:28.457708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48533194-56e9-4a47-b45a-f2f173fcd933 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:28.460186 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-48533194-56e9-4a47-b45a-f2f173fcd933 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:28.471592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:28.472801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:55:28.473856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:28.480652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 455/911] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jun 20 05:55:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:28.485408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0db0c5-e026-4f72-b96f-1fbd52ec0ecd None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:28.588587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0db0c5-e026-4f72-b96f-1fbd52ec0ecd None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:28.593374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6a08-56ed-49d9-9bc7-5c33a110409f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:28.593660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6a08-56ed-49d9-9bc7-5c33a110409f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:28.593936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6a08-56ed-49d9-9bc7-5c33a110409f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:28.596538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 456/912] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:28.600688 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11bde5-e006-44fa-8615-71a36e2d8f02 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:28.601053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11bde5-e006-44fa-8615-71a36e2d8f02 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:28.601336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11bde5-e006-44fa-8615-71a36e2d8f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:28.618488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ff11bde5-e006-44fa-8615-71a36e2d8f02 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:28.619764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ff11bde5-e006-44fa-8615-71a36e2d8f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:28.623820 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2349613-56b2-4143-84e8-4fbbaa3e8f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:28.624518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349613-56b2-4143-84e8-4fbbaa3e8f7e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:28.624805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349613-56b2-4143-84e8-4fbbaa3e8f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:28.625083 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349613-56b2-4143-84e8-4fbbaa3e8f7e None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:28.625797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2349613-56b2-4143-84e8-4fbbaa3e8f7e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:28.626107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2349613-56b2-4143-84e8-4fbbaa3e8f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:28.627477 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2349613-56b2-4143-84e8-4fbbaa3e8f7e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:28.633098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 457/913] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 20 05:55:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:28.638923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2349613-56b2-4143-84e8-4fbbaa3e8f7e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:28.704137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 457/914] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:28.713953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:28.727733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11bde5-e006-44fa-8615-71a36e2d8f02 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:28.763035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2349613-56b2-4143-84e8-4fbbaa3e8f7e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:28.798024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ab9f0-e2d8-4459-b99e-9c4af4d2db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:28.799091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ab9f0-e2d8-4459-b99e-9c4af4d2db5f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:28.799573 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ab9f0-e2d8-4459-b99e-9c4af4d2db5f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:28.800044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ab9f0-e2d8-4459-b99e-9c4af4d2db5f None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:28.801276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ab9f0-e2d8-4459-b99e-9c4af4d2db5f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:28.801815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ab9f0-e2d8-4459-b99e-9c4af4d2db5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:28.804015 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ab9f0-e2d8-4459-b99e-9c4af4d2db5f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:28.810076 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 458/915] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 20 05:55:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:28.815871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ab9f0-e2d8-4459-b99e-9c4af4d2db5f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:28.853322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11bde5-e006-44fa-8615-71a36e2d8f02 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:28.884567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:28.894772 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8483829-0fd5-4b43-b0cc-41c6243b5580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:28.895771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8483829-0fd5-4b43-b0cc-41c6243b5580 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:28.896288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8483829-0fd5-4b43-b0cc-41c6243b5580 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:28.896824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8483829-0fd5-4b43-b0cc-41c6243b5580 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:28.897873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8483829-0fd5-4b43-b0cc-41c6243b5580 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:28.899508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8483829-0fd5-4b43-b0cc-41c6243b5580 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:28.914581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 458/916] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:55:28 2022] POST /identity/v3/services => generated 241 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:55:28.916297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987691c-aa33-4389-b7c1-1c7a0993f14d None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:28.916884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987691c-aa33-4389-b7c1-1c7a0993f14d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:28.917358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987691c-aa33-4389-b7c1-1c7a0993f14d None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:28.919252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 459/917] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:28.928373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45c3e-05d8-428b-9c35-d5af194326a7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:28.928373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45c3e-05d8-428b-9c35-d5af194326a7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:28.928373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45c3e-05d8-428b-9c35-d5af194326a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:28.940171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ab9f0-e2d8-4459-b99e-9c4af4d2db5f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:28.942753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-64b45c3e-05d8-428b-9c35-d5af194326a7 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:28.944582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-64b45c3e-05d8-428b-9c35-d5af194326a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:28.970256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:28.998910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd86a01-c7c8-463a-bb90-e6bc097ffb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:28.999679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd86a01-c7c8-463a-bb90-e6bc097ffb86 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:29.000136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd86a01-c7c8-463a-bb90-e6bc097ffb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:29.000454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd86a01-c7c8-463a-bb90-e6bc097ffb86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:29.002085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd86a01-c7c8-463a-bb90-e6bc097ffb86 None admin] RBAC: Adding query filter params (interface=public, service_id=86b42bc3d076424db35ee0510812a396, region_id=RegionOne) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:29.002413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd86a01-c7c8-463a-bb90-e6bc097ffb86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:29.004407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd86a01-c7c8-463a-bb90-e6bc097ffb86 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:29.012114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 459/918] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 20 05:55:28 2022] GET /identity/v3/endpoints?service_id=86b42bc3d076424db35ee0510812a396&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:29.017742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd86a01-c7c8-463a-bb90-e6bc097ffb86 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:29.032856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 460/919] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:29.050837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b45c3e-05d8-428b-9c35-d5af194326a7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:29.142302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd86a01-c7c8-463a-bb90-e6bc097ffb86 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:29.168473 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b45c3e-05d8-428b-9c35-d5af194326a7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:29.188034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:29.189204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846b485-e44d-4899-a1e7-233b86ba61b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:29.189992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846b485-e44d-4899-a1e7-233b86ba61b4 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:29.190338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846b485-e44d-4899-a1e7-233b86ba61b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:29.191562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846b485-e44d-4899-a1e7-233b86ba61b4 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:29.191562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846b485-e44d-4899-a1e7-233b86ba61b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:29.193121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846b485-e44d-4899-a1e7-233b86ba61b4 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:29.203899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 460/920] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 20 05:55:29 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:55:29.215919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4effe9-fa52-4471-8c1a-7252ff4315e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:29.217136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4effe9-fa52-4471-8c1a-7252ff4315e9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:29.217608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4effe9-fa52-4471-8c1a-7252ff4315e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:29.218084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4effe9-fa52-4471-8c1a-7252ff4315e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:29.232088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4effe9-fa52-4471-8c1a-7252ff4315e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-ef4effe9-fa52-4471-8c1a-7252ff4315e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:29.241028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:29.242030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:29.242865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 461/921] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 20 05:55:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:29.256347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846b485-e44d-4899-a1e7-233b86ba61b4 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:29.299294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:29.361996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846b485-e44d-4899-a1e7-233b86ba61b4 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:29.399016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26136e-5a47-4d19-9db3-5e51c80cd8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:29.399680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26136e-5a47-4d19-9db3-5e51c80cd8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:29.399960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26136e-5a47-4d19-9db3-5e51c80cd8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:29.400231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26136e-5a47-4d19-9db3-5e51c80cd8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:29.401265 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26136e-5a47-4d19-9db3-5e51c80cd8d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:29.401568 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26136e-5a47-4d19-9db3-5e51c80cd8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:29.402932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26136e-5a47-4d19-9db3-5e51c80cd8d2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:29.413220 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 461/922] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 20 05:55:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:29.421435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4effe9-fa52-4471-8c1a-7252ff4315e9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:29.533027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4effe9-fa52-4471-8c1a-7252ff4315e9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:29.568147 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432b30-a7ae-4a56-ad59-0ce8e5cb5fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:29.568967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432b30-a7ae-4a56-ad59-0ce8e5cb5fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:29.569243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432b30-a7ae-4a56-ad59-0ce8e5cb5fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:29.569512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9432b30-a7ae-4a56-ad59-0ce8e5cb5fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:29.582673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9432b30-a7ae-4a56-ad59-0ce8e5cb5fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:29.586090 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9432b30-a7ae-4a56-ad59-0ce8e5cb5fd1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-d9432b30-a7ae-4a56-ad59-0ce8e5cb5fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:29.604700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:29.605629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:29.606520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:29.606520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:29.606520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:29.606520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:29.606520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 462/923] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:29.613870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26136e-5a47-4d19-9db3-5e51c80cd8d2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:29.734329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26136e-5a47-4d19-9db3-5e51c80cd8d2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:29.737128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:29.770279 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1229589-1b7e-4bbb-a905-585bae0c5968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:29.771164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1229589-1b7e-4bbb-a905-585bae0c5968 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:29.771512 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1229589-1b7e-4bbb-a905-585bae0c5968 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:29.771896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1229589-1b7e-4bbb-a905-585bae0c5968 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:29.772717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1229589-1b7e-4bbb-a905-585bae0c5968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:29.773091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1229589-1b7e-4bbb-a905-585bae0c5968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:29.774521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1229589-1b7e-4bbb-a905-585bae0c5968 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:29.792239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 462/924] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:29.793557 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432b30-a7ae-4a56-ad59-0ce8e5cb5fd1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:29.825919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:29.900119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9432b30-a7ae-4a56-ad59-0ce8e5cb5fd1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:29.913105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc669b1-7642-49f4-8415-0e62ae7e344b None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:29.913393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc669b1-7642-49f4-8415-0e62ae7e344b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:29.913658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc669b1-7642-49f4-8415-0e62ae7e344b None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:29.915132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 463/925] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:29.920032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e0d01-b43e-475c-b36d-dfddd2a6779f None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:29.920352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e0d01-b43e-475c-b36d-dfddd2a6779f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:29.920612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e0d01-b43e-475c-b36d-dfddd2a6779f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:29.940454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-368e0d01-b43e-475c-b36d-dfddd2a6779f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:29.941962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-368e0d01-b43e-475c-b36d-dfddd2a6779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:29.950279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4884f-1390-4e0d-8276-515c3643be06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:29.951363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4884f-1390-4e0d-8276-515c3643be06 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:29.951862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4884f-1390-4e0d-8276-515c3643be06 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:29.952430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4884f-1390-4e0d-8276-515c3643be06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:29.973786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4884f-1390-4e0d-8276-515c3643be06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:29.979095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4884f-1390-4e0d-8276-515c3643be06 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:30.024338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 464/926] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a3c4884f-1390-4e0d-8276-515c3643be06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:30.024548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:30.025675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:30.026597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:30.026597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:30.026597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:30.026597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:30.026597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:30.026597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:30.026597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:30.026597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:30.026597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:30.026597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:30.030089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e0d01-b43e-475c-b36d-dfddd2a6779f None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:30.036414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 463/927] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 20 05:55:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:30.057427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4884f-1390-4e0d-8276-515c3643be06 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:30.209774 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:30.227469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e0d01-b43e-475c-b36d-dfddd2a6779f None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:30.252022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:30.270745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4884f-1390-4e0d-8276-515c3643be06 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:30.275743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3671ece-f949-44f1-b2fd-a6fa8417b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:30.276442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3671ece-f949-44f1-b2fd-a6fa8417b500 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:30.276729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3671ece-f949-44f1-b2fd-a6fa8417b500 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:30.277008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3671ece-f949-44f1-b2fd-a6fa8417b500 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:30.277848 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3671ece-f949-44f1-b2fd-a6fa8417b500 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:30.278156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3671ece-f949-44f1-b2fd-a6fa8417b500 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:30.279593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3671ece-f949-44f1-b2fd-a6fa8417b500 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:30.297526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 465/928] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 20 05:55:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:30.303505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3671ece-f949-44f1-b2fd-a6fa8417b500 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:30.316106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f21fea-22f4-4b29-8c81-962d501efe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:30.317066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f21fea-22f4-4b29-8c81-962d501efe6e None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:30.317541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f21fea-22f4-4b29-8c81-962d501efe6e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:30.318061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f21fea-22f4-4b29-8c81-962d501efe6e None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:30.318997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f21fea-22f4-4b29-8c81-962d501efe6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:30.320698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f21fea-22f4-4b29-8c81-962d501efe6e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:30.322363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: WARNING keystone.server.flask.common [None req-35f21fea-22f4-4b29-8c81-962d501efe6e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 05:55:30.345755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.sql.core [None req-35f21fea-22f4-4b29-8c81-962d501efe6e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 05:55:30.345755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 05:55:30.345755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [parameters: {'id': '7af87744322a4bd5b4b6cee508d06d48', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 05:55:30.345755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80116) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-35f21fea-22f4-4b29-8c81-962d501efe6e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7af87744322a4bd5b4b6cee508d06d48.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7af87744322a4bd5b4b6cee508d06d48. Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:55:30.355973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 20 05:55:30.356826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application yield resource Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise self.value Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application session.commit() Jun 20 05:55:30.357791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.flush() Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application compat.raise_( Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 05:55:30.358674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 05:55:30.359573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:55:30.361249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [parameters: {'id': '7af87744322a4bd5b4b6cee508d06d48', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:30.363367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:30.365964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:30.368224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:30.368224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 20 05:55:30.368224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 20 05:55:30.368224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:30.368224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:30.368224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 20 05:55:30.368224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 20 05:55:30.368224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7af87744322a4bd5b4b6cee508d06d48. Jun 20 05:55:30.368224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:30.368224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 464/929] 10.222.0.13 () {60 vars in 1140 bytes} [Mon Jun 20 05:55:30 2022] POST /identity/v3/projects => generated 262 bytes in 305 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:30.368224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f21fea-22f4-4b29-8c81-962d501efe6e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:30.431446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3671ece-f949-44f1-b2fd-a6fa8417b500 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:30.478181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff9527-feae-4150-944f-c09f80e0d03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:30.478982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9527-feae-4150-944f-c09f80e0d03f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:30.479683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9527-feae-4150-944f-c09f80e0d03f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:30.479977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9527-feae-4150-944f-c09f80e0d03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:30.494118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff9527-feae-4150-944f-c09f80e0d03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:30.495205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f21fea-22f4-4b29-8c81-962d501efe6e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:30.495630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff9527-feae-4150-944f-c09f80e0d03f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-aeff9527-feae-4150-944f-c09f80e0d03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:30.519587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:30.520620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:30.522146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:30.522146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:30.522146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:30.522146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:30.522146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 466/930] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:30.527126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff9527-feae-4150-944f-c09f80e0d03f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:30.542353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece81200-ea8a-4f96-8e14-f60bd43983f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:30.544034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81200-ea8a-4f96-8e14-f60bd43983f4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:30.544719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81200-ea8a-4f96-8e14-f60bd43983f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:30.545490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81200-ea8a-4f96-8e14-f60bd43983f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:30.554597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece81200-ea8a-4f96-8e14-f60bd43983f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:30.557255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece81200-ea8a-4f96-8e14-f60bd43983f4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-ece81200-ea8a-4f96-8e14-f60bd43983f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:30.575482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:30.576459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:30.577364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:30.577364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:30.577364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:30.577364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:30.577364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:30.577364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:30.577364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:30.577364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:30.577809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:30.580454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 465/931] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:30.583941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece81200-ea8a-4f96-8e14-f60bd43983f4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:30.595861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:30.644704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff9527-feae-4150-944f-c09f80e0d03f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:30.683234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969d4cf-e5f8-4e3c-8417-138e42837d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:30.683957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d4cf-e5f8-4e3c-8417-138e42837d4e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:30.684248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d4cf-e5f8-4e3c-8417-138e42837d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:30.684570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d4cf-e5f8-4e3c-8417-138e42837d4e None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:30.685339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969d4cf-e5f8-4e3c-8417-138e42837d4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:30.685655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969d4cf-e5f8-4e3c-8417-138e42837d4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:30.687152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969d4cf-e5f8-4e3c-8417-138e42837d4e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:30.705067 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 467/932] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:30.706131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969d4cf-e5f8-4e3c-8417-138e42837d4e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:30.717025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece81200-ea8a-4f96-8e14-f60bd43983f4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:30.762396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2f57e-8a0b-49ed-88f8-e493f9938c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:30.763405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2f57e-8a0b-49ed-88f8-e493f9938c26 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:30.764408 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2f57e-8a0b-49ed-88f8-e493f9938c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:30.764909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2f57e-8a0b-49ed-88f8-e493f9938c26 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:30.766105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2f57e-8a0b-49ed-88f8-e493f9938c26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:30.766819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2f57e-8a0b-49ed-88f8-e493f9938c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:30.769122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2f57e-8a0b-49ed-88f8-e493f9938c26 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:30.773847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:30.800460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 466/933] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:30.831838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969d4cf-e5f8-4e3c-8417-138e42837d4e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:30.872112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837660c-1f6a-4176-ac29-3e518bef5c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:30.872960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837660c-1f6a-4176-ac29-3e518bef5c6c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:30.873245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837660c-1f6a-4176-ac29-3e518bef5c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:30.873520 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837660c-1f6a-4176-ac29-3e518bef5c6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:30.882317 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837660c-1f6a-4176-ac29-3e518bef5c6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:30.883811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837660c-1f6a-4176-ac29-3e518bef5c6c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-4837660c-1f6a-4176-ac29-3e518bef5c6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:30.899940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:30.901202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:30.902080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:30.902080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:30.902080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:30.902080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:30.902080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:30.902080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:30.902080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:30.902080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:30.902080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 468/934] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:30.907646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2f57e-8a0b-49ed-88f8-e493f9938c26 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:30.981611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:31.019766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2f57e-8a0b-49ed-88f8-e493f9938c26 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:31.055834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd7ca6-d0db-4974-ae9b-2b62b654f8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:31.056662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7ca6-d0db-4974-ae9b-2b62b654f8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:31.057042 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7ca6-d0db-4974-ae9b-2b62b654f8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:31.057415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7ca6-d0db-4974-ae9b-2b62b654f8f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:31.058298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7ca6-d0db-4974-ae9b-2b62b654f8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:31.058703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7ca6-d0db-4974-ae9b-2b62b654f8f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:31.060239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7ca6-d0db-4974-ae9b-2b62b654f8f7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:31.073605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 467/935] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:31.082059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837660c-1f6a-4176-ac29-3e518bef5c6c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:31.106922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b1946-2713-4103-9a7b-0edd14cd22e7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:31.107251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b1946-2713-4103-9a7b-0edd14cd22e7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:31.107474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b1946-2713-4103-9a7b-0edd14cd22e7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:31.110094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 468/936] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:31.114271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387a78f-8421-4759-b9cf-600c023c2528 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:31.115115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387a78f-8421-4759-b9cf-600c023c2528 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:31.115398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387a78f-8421-4759-b9cf-600c023c2528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:31.133179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7387a78f-8421-4759-b9cf-600c023c2528 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:31.134843 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7387a78f-8421-4759-b9cf-600c023c2528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:31.212423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 469/937] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:31.213304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837660c-1f6a-4176-ac29-3e518bef5c6c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:31.228822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387a78f-8421-4759-b9cf-600c023c2528 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:31.249908 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:31.262595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4807c-4fbe-43f5-93b8-6f21a65e43d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:31.263492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4807c-4fbe-43f5-93b8-6f21a65e43d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:31.264176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4807c-4fbe-43f5-93b8-6f21a65e43d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:31.264176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4807c-4fbe-43f5-93b8-6f21a65e43d6 None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/25a82cc64a424e3d87062043f24d5285/roles/74cbcc96b8814e84a977b222c3575a05` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:31.266343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4807c-4fbe-43f5-93b8-6f21a65e43d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=25a82cc64a424e3d87062043f24d5285, role_id=74cbcc96b8814e84a977b222c3575a05)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:31.267781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe4807c-4fbe-43f5-93b8-6f21a65e43d6 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:31.292343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 469/938] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:55:31 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/25a82cc64a424e3d87062043f24d5285/roles/74cbcc96b8814e84a977b222c3575a05 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:55:31.317051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:31.370436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387a78f-8421-4759-b9cf-600c023c2528 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:31.410854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b808b9c-bac7-439b-85fb-df7172f53237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:31.411908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b808b9c-bac7-439b-85fb-df7172f53237 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:31.412451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b808b9c-bac7-439b-85fb-df7172f53237 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:31.412867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b808b9c-bac7-439b-85fb-df7172f53237 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:31.414005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b808b9c-bac7-439b-85fb-df7172f53237 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:31.415546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b808b9c-bac7-439b-85fb-df7172f53237 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:31.424348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369a3ba-e234-4f5e-9bd2-5f92c6b76b6d None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:31.424693 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369a3ba-e234-4f5e-9bd2-5f92c6b76b6d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:31.424953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369a3ba-e234-4f5e-9bd2-5f92c6b76b6d None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:31.426623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 470/939] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-9b808b9c-bac7-439b-85fb-df7172f53237 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:31.429253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:31.430286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:31.431152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 470/940] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 20 05:55:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:31.432226 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ceb8-08c0-4a1f-8548-23d13ced0fe0 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:31.432829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ceb8-08c0-4a1f-8548-23d13ced0fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:31.432829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ceb8-08c0-4a1f-8548-23d13ced0fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:31.439920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b808b9c-bac7-439b-85fb-df7172f53237 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:31.459390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-46c9ceb8-08c0-4a1f-8548-23d13ced0fe0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:31.460635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-46c9ceb8-08c0-4a1f-8548-23d13ced0fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:31.539946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 471/941] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:31.561254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b808b9c-bac7-439b-85fb-df7172f53237 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:31.565070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ceb8-08c0-4a1f-8548-23d13ced0fe0 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:31.587622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:31.609645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4f907-53f5-48dd-b95d-2add5ff843d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:31.610897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f907-53f5-48dd-b95d-2add5ff843d9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:31.611190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f907-53f5-48dd-b95d-2add5ff843d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:31.611473 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4f907-53f5-48dd-b95d-2add5ff843d9 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:31.612197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4f907-53f5-48dd-b95d-2add5ff843d9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:31.612539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4f907-53f5-48dd-b95d-2add5ff843d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:31.614380 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4f907-53f5-48dd-b95d-2add5ff843d9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:31.626892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 471/942] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 20 05:55:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:31.627857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4f907-53f5-48dd-b95d-2add5ff843d9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:31.699356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ceb8-08c0-4a1f-8548-23d13ced0fe0 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:31.716359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:31.741922 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c242f4-1447-4625-ad8c-cf173c4e0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:31.743135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c242f4-1447-4625-ad8c-cf173c4e0fdf None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:31.743678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c242f4-1447-4625-ad8c-cf173c4e0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:31.744177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c242f4-1447-4625-ad8c-cf173c4e0fdf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:31.745168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c242f4-1447-4625-ad8c-cf173c4e0fdf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:31.746806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c242f4-1447-4625-ad8c-cf173c4e0fdf None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:31.754684 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4f907-53f5-48dd-b95d-2add5ff843d9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-94c242f4-1447-4625-ad8c-cf173c4e0fdf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:31.761055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:31.762017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 05:55:31.762872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:31.770423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 472/943] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jun 20 05:55:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:31.771667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c242f4-1447-4625-ad8c-cf173c4e0fdf None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:31.790988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ced13-d3cf-4553-8e88-9948cff95bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:31.792000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ced13-d3cf-4553-8e88-9948cff95bac None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:31.792559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ced13-d3cf-4553-8e88-9948cff95bac None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:31.793056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ced13-d3cf-4553-8e88-9948cff95bac None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:31.794030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ced13-d3cf-4553-8e88-9948cff95bac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:31.794676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ced13-d3cf-4553-8e88-9948cff95bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:31.796338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ced13-d3cf-4553-8e88-9948cff95bac None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:31.804360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 472/944] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 20 05:55:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:31.809528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ced13-d3cf-4553-8e88-9948cff95bac None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:31.885247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c242f4-1447-4625-ad8c-cf173c4e0fdf None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:31.888687 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:31.921906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e04feb-2eb9-482b-8b92-0d1e8838e028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:31.922297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e04feb-2eb9-482b-8b92-0d1e8838e028 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:31.922586 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e04feb-2eb9-482b-8b92-0d1e8838e028 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:31.922864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e04feb-2eb9-482b-8b92-0d1e8838e028 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:31.923609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e04feb-2eb9-482b-8b92-0d1e8838e028 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:31.923955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e04feb-2eb9-482b-8b92-0d1e8838e028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:31.925594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e04feb-2eb9-482b-8b92-0d1e8838e028 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:31.935864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 473/945] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 20 05:55:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:31.936762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e04feb-2eb9-482b-8b92-0d1e8838e028 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:31.948076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ced13-d3cf-4553-8e88-9948cff95bac None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:31.983735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:32.001278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b0f3d-2bfe-4299-a61e-de9277f95ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:32.002557 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b0f3d-2bfe-4299-a61e-de9277f95ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:32.002851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b0f3d-2bfe-4299-a61e-de9277f95ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:32.003126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b0f3d-2bfe-4299-a61e-de9277f95ef1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:32.004168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b0f3d-2bfe-4299-a61e-de9277f95ef1 None admin] RBAC: Adding query filter params (interface=public, service_id=88967561b70e46d1a2d04971970c2000, region_id=RegionOne) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:32.004510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b0f3d-2bfe-4299-a61e-de9277f95ef1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:32.006617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b0f3d-2bfe-4299-a61e-de9277f95ef1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:32.013989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 473/946] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 20 05:55:31 2022] GET /identity/v3/endpoints?service_id=88967561b70e46d1a2d04971970c2000&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:32.019868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b0f3d-2bfe-4299-a61e-de9277f95ef1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:32.057901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e04feb-2eb9-482b-8b92-0d1e8838e028 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:32.093498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453993b-11a8-4b32-bf43-bfa6bd144c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:32.094172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453993b-11a8-4b32-bf43-bfa6bd144c95 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:32.094454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453993b-11a8-4b32-bf43-bfa6bd144c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:32.094730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453993b-11a8-4b32-bf43-bfa6bd144c95 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:32.095561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453993b-11a8-4b32-bf43-bfa6bd144c95 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:32.095876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453993b-11a8-4b32-bf43-bfa6bd144c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:32.097387 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453993b-11a8-4b32-bf43-bfa6bd144c95 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:32.107909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 474/947] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 20 05:55:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:32.109229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453993b-11a8-4b32-bf43-bfa6bd144c95 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:32.137955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b0f3d-2bfe-4299-a61e-de9277f95ef1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:32.152282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:32.177461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419986c2-eb52-4bed-9ed8-beec23ab12c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:32.178602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419986c2-eb52-4bed-9ed8-beec23ab12c7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:32.179091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419986c2-eb52-4bed-9ed8-beec23ab12c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:32.179579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419986c2-eb52-4bed-9ed8-beec23ab12c7 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:32.180592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419986c2-eb52-4bed-9ed8-beec23ab12c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:32.182234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419986c2-eb52-4bed-9ed8-beec23ab12c7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:32.196872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 474/948] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 20 05:55:32 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:55:32.212435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453993b-11a8-4b32-bf43-bfa6bd144c95 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:32.220596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:32.251818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb595d0-76de-4ae0-a353-3dd62fdcd1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:32.252659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb595d0-76de-4ae0-a353-3dd62fdcd1bf None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:32.253045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb595d0-76de-4ae0-a353-3dd62fdcd1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:32.253417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb595d0-76de-4ae0-a353-3dd62fdcd1bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:32.254262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb595d0-76de-4ae0-a353-3dd62fdcd1bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:32.255791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb595d0-76de-4ae0-a353-3dd62fdcd1bf None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:32.284964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 475/949] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 20 05:55:32 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:55:32.981177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eb087-af64-4f2c-891f-1b871996b677 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:32.982202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eb087-af64-4f2c-891f-1b871996b677 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:32.982708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9eb087-af64-4f2c-891f-1b871996b677 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:32.984604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 475/950] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:32.991113 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb218-03b9-4531-a487-7377f21676b8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:32.991402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb218-03b9-4531-a487-7377f21676b8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:32.991679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48beb218-03b9-4531-a487-7377f21676b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:33.008959 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-48beb218-03b9-4531-a487-7377f21676b8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:33.010145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-48beb218-03b9-4531-a487-7377f21676b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:33.094470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 476/951] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:33.119739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9eb087-af64-4f2c-891f-1b871996b677 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:33.226105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9eb087-af64-4f2c-891f-1b871996b677 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:33.274094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75666416-cb80-4b49-9ff6-73432a3d0527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:33.275138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75666416-cb80-4b49-9ff6-73432a3d0527 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:33.275898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75666416-cb80-4b49-9ff6-73432a3d0527 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:33.276402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75666416-cb80-4b49-9ff6-73432a3d0527 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:33.277331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75666416-cb80-4b49-9ff6-73432a3d0527 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:33.278979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75666416-cb80-4b49-9ff6-73432a3d0527 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:33.293913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.sql.core [None req-75666416-cb80-4b49-9ff6-73432a3d0527 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 05:55:33.293913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 05:55:33.293913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [parameters: {'user_id': 'b051ab5fd931493aa690504c3742ab96', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 05:55:33.293913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80116) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-75666416-cb80-4b49-9ff6-73432a3d0527 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Jun 20 05:55:33.302552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:55:33.303512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application yield resource Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application next(self.gen) Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise self.value Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application session.commit() Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 05:55:33.304879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.session.flush() Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application compat.raise_( Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 05:55:33.305798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 05:55:33.306741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application conn.query(q) Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application result.read() Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 05:55:33.307624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b051ab5fd931493aa690504c3742ab96', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:33.309755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 20 05:55:33.311776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 20 05:55:33.314033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 20 05:55:33.314033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 20 05:55:33.314033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 05:55:33.314033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 05:55:33.314033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 05:55:33.314033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:33.316374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 476/952] 10.222.0.13 () {60 vars in 1131 bytes} [Mon Jun 20 05:55:33 2022] POST /identity/v3/users => generated 160 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:33.323464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb218-03b9-4531-a487-7377f21676b8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:33.417504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651f88c-8f81-40d3-94b7-eaf8b4729c2a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:33.418169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651f88c-8f81-40d3-94b7-eaf8b4729c2a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:33.418667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651f88c-8f81-40d3-94b7-eaf8b4729c2a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:33.421049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:33.429058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 477/953] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:33 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:33.434005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48beb218-03b9-4531-a487-7377f21676b8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:33.434597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754a098-019b-41aa-9a5e-8f1d44130df0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:33.434841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754a098-019b-41aa-9a5e-8f1d44130df0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:33.435111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754a098-019b-41aa-9a5e-8f1d44130df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:33.454149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f754a098-019b-41aa-9a5e-8f1d44130df0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:33.456092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f754a098-019b-41aa-9a5e-8f1d44130df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:33.469657 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7206a-b216-497b-ab7e-1c449e1552ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:33.470468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7206a-b216-497b-ab7e-1c449e1552ec None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:33.470756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7206a-b216-497b-ab7e-1c449e1552ec None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:33.471037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7206a-b216-497b-ab7e-1c449e1552ec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:33.480258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7206a-b216-497b-ab7e-1c449e1552ec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:33.481905 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7206a-b216-497b-ab7e-1c449e1552ec None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:33.493195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-2ce7206a-b216-497b-ab7e-1c449e1552ec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:33.500742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:33.501878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:33.502883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:33.502883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:33.502883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:33.502883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:33.502883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:33.502883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:33.502883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:33.502883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:33.502883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 05:55:33.502883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:33.505510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 477/954] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:55:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:33.511753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7206a-b216-497b-ab7e-1c449e1552ec None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:33.544432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 478/955] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:33.567361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754a098-019b-41aa-9a5e-8f1d44130df0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:33.653368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7206a-b216-497b-ab7e-1c449e1552ec None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:33.679206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754a098-019b-41aa-9a5e-8f1d44130df0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:33.696271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb165e55-126e-471e-8123-32dcf3095f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:33.697510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165e55-126e-471e-8123-32dcf3095f16 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:33.698008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165e55-126e-471e-8123-32dcf3095f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:33.698527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb165e55-126e-471e-8123-32dcf3095f16 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:33.699493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb165e55-126e-471e-8123-32dcf3095f16 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:33.699872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb165e55-126e-471e-8123-32dcf3095f16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:33.701355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb165e55-126e-471e-8123-32dcf3095f16 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:33.726033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144f68c-94d6-46a0-a6fa-cd86c8650a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:33.727089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f68c-94d6-46a0-a6fa-cd86c8650a94 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:33.727514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f68c-94d6-46a0-a6fa-cd86c8650a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:33.727967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144f68c-94d6-46a0-a6fa-cd86c8650a94 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:33.740911 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144f68c-94d6-46a0-a6fa-cd86c8650a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:33.748416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 478/956] 10.222.0.13 () {56 vars in 1101 bytes} [Mon Jun 20 05:55:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-7144f68c-94d6-46a0-a6fa-cd86c8650a94 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:33.751900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:33.752938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:33.754238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 479/957] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 20 05:55:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:33.760423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb165e55-126e-471e-8123-32dcf3095f16 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:33.786422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:33.874879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb165e55-126e-471e-8123-32dcf3095f16 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:33.911442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b97d8-fd08-4de2-b4c6-945a0c925149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:33.912123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b97d8-fd08-4de2-b4c6-945a0c925149 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:33.912442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b97d8-fd08-4de2-b4c6-945a0c925149 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:33.912723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b97d8-fd08-4de2-b4c6-945a0c925149 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:33.913493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b97d8-fd08-4de2-b4c6-945a0c925149 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:33.913803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b97d8-fd08-4de2-b4c6-945a0c925149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:33.915318 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b97d8-fd08-4de2-b4c6-945a0c925149 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:33.924753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 479/958] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 20 05:55:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:33.931200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144f68c-94d6-46a0-a6fa-cd86c8650a94 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:33.963450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:34.042124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144f68c-94d6-46a0-a6fa-cd86c8650a94 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:34.076954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b488e-7a21-4700-b01b-b97940cc4430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:34.077765 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b488e-7a21-4700-b01b-b97940cc4430 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.078047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b488e-7a21-4700-b01b-b97940cc4430 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.078316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b488e-7a21-4700-b01b-b97940cc4430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.090093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b488e-7a21-4700-b01b-b97940cc4430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:34.091707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b488e-7a21-4700-b01b-b97940cc4430 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-445b488e-7a21-4700-b01b-b97940cc4430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:34.109200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:34.110079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:34.111367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:34.111367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:34.111367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:34.111367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:34.111367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 480/959] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:34.116257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b97d8-fd08-4de2-b4c6-945a0c925149 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:34.182498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:34.217299 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b97d8-fd08-4de2-b4c6-945a0c925149 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:34.258438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab0319-5ecc-4257-8eed-5c8db6303412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:34.259380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0319-5ecc-4257-8eed-5c8db6303412 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.259977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0319-5ecc-4257-8eed-5c8db6303412 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.260480 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab0319-5ecc-4257-8eed-5c8db6303412 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.261384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab0319-5ecc-4257-8eed-5c8db6303412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:34.261876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab0319-5ecc-4257-8eed-5c8db6303412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:34.263446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab0319-5ecc-4257-8eed-5c8db6303412 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:34.275667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 480/960] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:34.281504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b488e-7a21-4700-b01b-b97940cc4430 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:34.310649 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4440f-742e-4e2b-b501-90edecb1ffb4 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.310931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4440f-742e-4e2b-b501-90edecb1ffb4 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.311137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4440f-742e-4e2b-b501-90edecb1ffb4 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.312752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 481/961] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:34.317342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335738a-4a77-4515-b138-4973c7d62de1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.317666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335738a-4a77-4515-b138-4973c7d62de1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.317953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335738a-4a77-4515-b138-4973c7d62de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.336030 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b335738a-4a77-4515-b138-4973c7d62de1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:34.337277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b335738a-4a77-4515-b138-4973c7d62de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:34.369544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:34.389208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b488e-7a21-4700-b01b-b97940cc4430 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:34.409708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 482/962] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:34.422895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2a75b-f644-441a-8292-61a745322dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:34.423702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2a75b-f644-441a-8292-61a745322dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.423982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2a75b-f644-441a-8292-61a745322dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.424255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2a75b-f644-441a-8292-61a745322dd0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.429991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258278fb-2686-4af1-b8e8-9d06a7753e2c None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.430286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258278fb-2686-4af1-b8e8-9d06a7753e2c None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.430565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258278fb-2686-4af1-b8e8-9d06a7753e2c None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.432047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 483/963] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:34.432516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2a75b-f644-441a-8292-61a745322dd0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:34.434032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2a75b-f644-441a-8292-61a745322dd0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:34.436204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258278fb-2686-4af1-b8e8-9d06a7753e2c None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-44b2a75b-f644-441a-8292-61a745322dd0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:34.449121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:34.450129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:34.451078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:34.451078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:34.451078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:34.451078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:34.451078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:34.451078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:34.451078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:34.451078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:34.451078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 05:55:34.451078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:34.451078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 481/964] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 20 05:55:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:34.452682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843a8dc-dddd-4b10-96e2-e4be42a4ce98 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.452979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843a8dc-dddd-4b10-96e2-e4be42a4ce98 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.453259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843a8dc-dddd-4b10-96e2-e4be42a4ce98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.473817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a843a8dc-dddd-4b10-96e2-e4be42a4ce98 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:34.475027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a843a8dc-dddd-4b10-96e2-e4be42a4ce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:34.498314 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:34.540246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258278fb-2686-4af1-b8e8-9d06a7753e2c None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:34.540462 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 482/965] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:34.540901 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843a8dc-dddd-4b10-96e2-e4be42a4ce98 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:34.574965 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e4471-66b7-4885-a2de-a1518f715934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:34.575690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e4471-66b7-4885-a2de-a1518f715934 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.575970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e4471-66b7-4885-a2de-a1518f715934 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.576243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e4471-66b7-4885-a2de-a1518f715934 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.576923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e4471-66b7-4885-a2de-a1518f715934 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:34.578283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e4471-66b7-4885-a2de-a1518f715934 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-a67e4471-66b7-4885-a2de-a1518f715934 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:34.589971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:34.595979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:34.597004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 484/966] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 20 05:55:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:34.597824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e4471-66b7-4885-a2de-a1518f715934 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:34.610840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:34.643900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843a8dc-dddd-4b10-96e2-e4be42a4ce98 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:34.680000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df615a-c275-4422-8c7c-b47108897af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:34.680813 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df615a-c275-4422-8c7c-b47108897af4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.681185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df615a-c275-4422-8c7c-b47108897af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.681526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df615a-c275-4422-8c7c-b47108897af4 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.682436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df615a-c275-4422-8c7c-b47108897af4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:34.682819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df615a-c275-4422-8c7c-b47108897af4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:34.684337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df615a-c275-4422-8c7c-b47108897af4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:34.692450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e4471-66b7-4885-a2de-a1518f715934 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:34.704820 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 483/967] 10.222.0.13 () {56 vars in 1149 bytes} [Mon Jun 20 05:55:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:34.706112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df615a-c275-4422-8c7c-b47108897af4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:34.715327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:34.727186 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829e61e-8faa-44d3-88bb-461dc4f90b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:34.727975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e61e-8faa-44d3-88bb-461dc4f90b36 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.728286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e61e-8faa-44d3-88bb-461dc4f90b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.728585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e61e-8faa-44d3-88bb-461dc4f90b36 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.729242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829e61e-8faa-44d3-88bb-461dc4f90b36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:34.730595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829e61e-8faa-44d3-88bb-461dc4f90b36 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-f829e61e-8faa-44d3-88bb-461dc4f90b36 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:34.742466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:34.743685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:34.744782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 485/968] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:34.745638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829e61e-8faa-44d3-88bb-461dc4f90b36 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:34.809862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df615a-c275-4422-8c7c-b47108897af4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:34.838990 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:34.847318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc658cc-c3d6-4b69-8e7e-09b7cdb29cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:34.847981 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc658cc-c3d6-4b69-8e7e-09b7cdb29cbd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.848260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc658cc-c3d6-4b69-8e7e-09b7cdb29cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.848513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829e61e-8faa-44d3-88bb-461dc4f90b36 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:34.848615 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc658cc-c3d6-4b69-8e7e-09b7cdb29cbd None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.849882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc658cc-c3d6-4b69-8e7e-09b7cdb29cbd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:34.850189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc658cc-c3d6-4b69-8e7e-09b7cdb29cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:34.851553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc658cc-c3d6-4b69-8e7e-09b7cdb29cbd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:34.856543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 484/969] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 20 05:55:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:34.857160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc658cc-c3d6-4b69-8e7e-09b7cdb29cbd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:34.885487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4caa8-82e0-4ca1-a4dd-3e96f2ced7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:34.886360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4caa8-82e0-4ca1-a4dd-3e96f2ced7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.886643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4caa8-82e0-4ca1-a4dd-3e96f2ced7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.886915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4caa8-82e0-4ca1-a4dd-3e96f2ced7b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.938662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:34.952124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4caa8-82e0-4ca1-a4dd-3e96f2ced7b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:34.953594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4caa8-82e0-4ca1-a4dd-3e96f2ced7b2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:34.953907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc658cc-c3d6-4b69-8e7e-09b7cdb29cbd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:34.987938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b97836-4808-415b-be50-31429d8ee77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:34.988609 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b97836-4808-415b-be50-31429d8ee77f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:34.988891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b97836-4808-415b-be50-31429d8ee77f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:34.989163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b97836-4808-415b-be50-31429d8ee77f None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:34.989933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b97836-4808-415b-be50-31429d8ee77f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:34.990238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b97836-4808-415b-be50-31429d8ee77f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:34.991583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b97836-4808-415b-be50-31429d8ee77f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:34.996092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 485/970] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:34.996934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b97836-4808-415b-be50-31429d8ee77f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:35.051103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:35.060813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 486/971] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:34 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:55:35.060813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4caa8-82e0-4ca1-a4dd-3e96f2ced7b2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:35.093970 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b97836-4808-415b-be50-31429d8ee77f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:35.126374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b856f6-7318-4733-a89c-38ffddae76c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:35.127025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b856f6-7318-4733-a89c-38ffddae76c7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:35.127306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b856f6-7318-4733-a89c-38ffddae76c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:35.127579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b856f6-7318-4733-a89c-38ffddae76c7 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:35.128273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b856f6-7318-4733-a89c-38ffddae76c7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:35.128611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b856f6-7318-4733-a89c-38ffddae76c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:35.129961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b856f6-7318-4733-a89c-38ffddae76c7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:35.135254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 486/972] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 20 05:55:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:35.136027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b856f6-7318-4733-a89c-38ffddae76c7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:35.142462 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:35.158195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4caa8-82e0-4ca1-a4dd-3e96f2ced7b2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:35.192252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e1c49-d003-403e-9b75-2d326f6426ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:35.193472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e1c49-d003-403e-9b75-2d326f6426ca None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:35.193756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e1c49-d003-403e-9b75-2d326f6426ca None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:35.194035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e1c49-d003-403e-9b75-2d326f6426ca None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:35.194743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e1c49-d003-403e-9b75-2d326f6426ca None admin] RBAC: Adding query filter params (type=compute) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:35.195053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e1c49-d003-403e-9b75-2d326f6426ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:35.196434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e1c49-d003-403e-9b75-2d326f6426ca None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:35.200786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 487/973] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:35.201529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e1c49-d003-403e-9b75-2d326f6426ca None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:35.244626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b856f6-7318-4733-a89c-38ffddae76c7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:35.267606 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:35.283468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7debe4c-c501-4a41-903c-cb478b677724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:35.284294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7debe4c-c501-4a41-903c-cb478b677724 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:35.284995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7debe4c-c501-4a41-903c-cb478b677724 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:35.285299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7debe4c-c501-4a41-903c-cb478b677724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:35.296349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7debe4c-c501-4a41-903c-cb478b677724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:35.297839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7debe4c-c501-4a41-903c-cb478b677724 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c7debe4c-c501-4a41-903c-cb478b677724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:35.316836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:35.318428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:35.319344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:35.319344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:35.319344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:35.319344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:35.319344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 487/974] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:35.324433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7debe4c-c501-4a41-903c-cb478b677724 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:35.342262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e1c49-d003-403e-9b75-2d326f6426ca None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:35.382493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7f045-ed8e-4839-86f0-d80f1e5483f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:35.383168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7f045-ed8e-4839-86f0-d80f1e5483f5 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:35.383462 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7f045-ed8e-4839-86f0-d80f1e5483f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:35.383745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7f045-ed8e-4839-86f0-d80f1e5483f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:35.384541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7f045-ed8e-4839-86f0-d80f1e5483f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:35.386239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7f045-ed8e-4839-86f0-d80f1e5483f5 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:35.410266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 488/975] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 20 05:55:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:55:35.441496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7debe4c-c501-4a41-903c-cb478b677724 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:35.487298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c8848-aa51-4d54-9d07-78a5c61f512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:35.488428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c8848-aa51-4d54-9d07-78a5c61f512f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:35.488936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c8848-aa51-4d54-9d07-78a5c61f512f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:35.489954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c8848-aa51-4d54-9d07-78a5c61f512f None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:35.490906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c8848-aa51-4d54-9d07-78a5c61f512f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:35.491449 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c8848-aa51-4d54-9d07-78a5c61f512f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:35.493120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c8848-aa51-4d54-9d07-78a5c61f512f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:35.506746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 488/976] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:35.512464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7f045-ed8e-4839-86f0-d80f1e5483f5 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:35.521860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:35.625349 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7f045-ed8e-4839-86f0-d80f1e5483f5 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:35.661834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba51e2-d65d-4b61-8e5a-73b52823cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:35.662541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba51e2-d65d-4b61-8e5a-73b52823cd7d None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:35.662829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba51e2-d65d-4b61-8e5a-73b52823cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:35.663104 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba51e2-d65d-4b61-8e5a-73b52823cd7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:35.670514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba51e2-d65d-4b61-8e5a-73b52823cd7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:35.671968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba51e2-d65d-4b61-8e5a-73b52823cd7d None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-daba51e2-d65d-4b61-8e5a-73b52823cd7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:35.687713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:35.688691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:35.689619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:35.689619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:35.689619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:35.689619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:35.689619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:35.689619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:35.689619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:35.689619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:35.689619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 489/977] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:35.694974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c8848-aa51-4d54-9d07-78a5c61f512f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:35.725674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:35.799392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c8848-aa51-4d54-9d07-78a5c61f512f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:35.841794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc89d8-ad0f-4218-8066-5d281ab6616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:35.842463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc89d8-ad0f-4218-8066-5d281ab6616c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:35.842749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc89d8-ad0f-4218-8066-5d281ab6616c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:35.843025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc89d8-ad0f-4218-8066-5d281ab6616c None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:35.843815 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc89d8-ad0f-4218-8066-5d281ab6616c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:35.844127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc89d8-ad0f-4218-8066-5d281ab6616c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:35.845592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc89d8-ad0f-4218-8066-5d281ab6616c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:35.863325 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 489/978] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:35.865473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba51e2-d65d-4b61-8e5a-73b52823cd7d None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:35.933769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:35.970853 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba51e2-d65d-4b61-8e5a-73b52823cd7d None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:36.005737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36535a74-0271-4093-bea2-18d4d7de7163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:36.006382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36535a74-0271-4093-bea2-18d4d7de7163 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:36.006673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36535a74-0271-4093-bea2-18d4d7de7163 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:36.006953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36535a74-0271-4093-bea2-18d4d7de7163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:36.007788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36535a74-0271-4093-bea2-18d4d7de7163 None admin] RBAC: Adding query filter params (role.id=74cbcc96b8814e84a977b222c3575a05, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=25a82cc64a424e3d87062043f24d5285) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:36.008108 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36535a74-0271-4093-bea2-18d4d7de7163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:36.009575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36535a74-0271-4093-bea2-18d4d7de7163 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:36.022539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 490/979] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:35 2022] GET /identity/v3/role_assignments?user.id=25a82cc64a424e3d87062043f24d5285&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=74cbcc96b8814e84a977b222c3575a05 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:37.233038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae42a8-b5f8-4ee6-88ba-6106ef7daf6a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:37.233038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae42a8-b5f8-4ee6-88ba-6106ef7daf6a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:37.233038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae42a8-b5f8-4ee6-88ba-6106ef7daf6a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:37.233683 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 490/980] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:37.238298 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab907ab-81ca-48be-b4b9-2267cf1001bd None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:37.238669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab907ab-81ca-48be-b4b9-2267cf1001bd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:37.238844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab907ab-81ca-48be-b4b9-2267cf1001bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:37.255941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-cab907ab-81ca-48be-b4b9-2267cf1001bd None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:37.257138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-cab907ab-81ca-48be-b4b9-2267cf1001bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:37.324116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 491/981] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:37.346695 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae42a8-b5f8-4ee6-88ba-6106ef7daf6a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:37.436727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:37.450541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae42a8-b5f8-4ee6-88ba-6106ef7daf6a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:37.469038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290aa10-87af-466b-be54-2caa42910c28 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:37.469327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290aa10-87af-466b-be54-2caa42910c28 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:37.469603 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290aa10-87af-466b-be54-2caa42910c28 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:37.470956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 492/982] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:37.476366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0e4b-0ff9-4fef-a147-8d7bc6e6e564 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:37.476663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0e4b-0ff9-4fef-a147-8d7bc6e6e564 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:37.476946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0e4b-0ff9-4fef-a147-8d7bc6e6e564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:37.485249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefa267-1087-4b05-a482-811d2e9c084a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:37.485845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefa267-1087-4b05-a482-811d2e9c084a None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:37.486129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefa267-1087-4b05-a482-811d2e9c084a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:37.486405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefa267-1087-4b05-a482-811d2e9c084a None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:37.487135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefa267-1087-4b05-a482-811d2e9c084a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:37.488545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefa267-1087-4b05-a482-811d2e9c084a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:37.494001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-de7f0e4b-0ff9-4fef-a147-8d7bc6e6e564 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:37.495140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-de7f0e4b-0ff9-4fef-a147-8d7bc6e6e564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:37.516346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 491/983] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:55:37 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:55:37.562655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:37.582359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 493/984] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:37.606143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefa267-1087-4b05-a482-811d2e9c084a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:37.716040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefa267-1087-4b05-a482-811d2e9c084a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:37.749762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fc971-a816-4f9b-b8c5-a42afc234da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:37.750482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fc971-a816-4f9b-b8c5-a42afc234da3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:37.750762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fc971-a816-4f9b-b8c5-a42afc234da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:37.751034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7fc971-a816-4f9b-b8c5-a42afc234da3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:37.751681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fc971-a816-4f9b-b8c5-a42afc234da3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:37.753074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7fc971-a816-4f9b-b8c5-a42afc234da3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-df7fc971-a816-4f9b-b8c5-a42afc234da3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:37.765530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:37.766613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:37.767441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 492/985] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 20 05:55:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:37.772658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0e4b-0ff9-4fef-a147-8d7bc6e6e564 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:37.871485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0e4b-0ff9-4fef-a147-8d7bc6e6e564 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:37.904993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7fbe5-d82a-4260-b064-7d07905889eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:37.905652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7fbe5-d82a-4260-b064-7d07905889eb None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:37.905933 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7fbe5-d82a-4260-b064-7d07905889eb None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:37.906203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7fbe5-d82a-4260-b064-7d07905889eb None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:37.906900 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7fbe5-d82a-4260-b064-7d07905889eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:37.907203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7fbe5-d82a-4260-b064-7d07905889eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:37.908581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7fbe5-d82a-4260-b064-7d07905889eb None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:37.917930 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 494/986] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 20 05:55:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:37.923411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fc971-a816-4f9b-b8c5-a42afc234da3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:37.939969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:38.030519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7fc971-a816-4f9b-b8c5-a42afc234da3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:38.063861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b385e-ceb7-46de-a37d-c236ffdfd3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:38.064551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b385e-ceb7-46de-a37d-c236ffdfd3bf None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:38.064840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b385e-ceb7-46de-a37d-c236ffdfd3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:38.065119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b385e-ceb7-46de-a37d-c236ffdfd3bf None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:38.065826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b385e-ceb7-46de-a37d-c236ffdfd3bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:38.066138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b385e-ceb7-46de-a37d-c236ffdfd3bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:38.068040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b385e-ceb7-46de-a37d-c236ffdfd3bf None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:38.076365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 493/987] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 20 05:55:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:38.078489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9ede9-fecb-46f6-b237-19dda344a637 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:38.078781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9ede9-fecb-46f6-b237-19dda344a637 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:38.078912 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b385e-ceb7-46de-a37d-c236ffdfd3bf None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:38.079054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9ede9-fecb-46f6-b237-19dda344a637 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:38.080562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 495/988] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:38.086210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc310-091a-4da0-8dc6-233702173853 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:38.086506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc310-091a-4da0-8dc6-233702173853 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:38.086787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc310-091a-4da0-8dc6-233702173853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:38.103209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-510bc310-091a-4da0-8dc6-233702173853 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:38.104437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-510bc310-091a-4da0-8dc6-233702173853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:38.153800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:38.163941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:38.186505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b385e-ceb7-46de-a37d-c236ffdfd3bf None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:38.189428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 496/989] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:38.202771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bc310-091a-4da0-8dc6-233702173853 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:38.221274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38bcb8-24e1-4057-8598-ac3b660b6ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:38.222219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38bcb8-24e1-4057-8598-ac3b660b6ddb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:38.222685 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38bcb8-24e1-4057-8598-ac3b660b6ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:38.223146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38bcb8-24e1-4057-8598-ac3b660b6ddb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:38.224761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38bcb8-24e1-4057-8598-ac3b660b6ddb None admin] RBAC: Adding query filter params (interface=admin, service_id=88967561b70e46d1a2d04971970c2000, region_id=RegionOne) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:38.225267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38bcb8-24e1-4057-8598-ac3b660b6ddb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:38.226894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c38bcb8-24e1-4057-8598-ac3b660b6ddb None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:38.232459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 494/990] 10.222.0.13 () {56 vars in 1249 bytes} [Mon Jun 20 05:55:38 2022] GET /identity/v3/endpoints?service_id=88967561b70e46d1a2d04971970c2000&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:38.238199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38bcb8-24e1-4057-8598-ac3b660b6ddb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:38.314487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bc310-091a-4da0-8dc6-233702173853 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:38.350555 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33206a85-c577-4bd5-a0e5-e2320bbbe4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:38.351343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33206a85-c577-4bd5-a0e5-e2320bbbe4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:38.351630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33206a85-c577-4bd5-a0e5-e2320bbbe4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:38.351908 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33206a85-c577-4bd5-a0e5-e2320bbbe4a6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:38.352591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33206a85-c577-4bd5-a0e5-e2320bbbe4a6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:38.353973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38bcb8-24e1-4057-8598-ac3b660b6ddb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:38.354076 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33206a85-c577-4bd5-a0e5-e2320bbbe4a6 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-33206a85-c577-4bd5-a0e5-e2320bbbe4a6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:38.365513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:38.366543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:38.367377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 497/991] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Jun 20 05:55:38 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:38.372499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33206a85-c577-4bd5-a0e5-e2320bbbe4a6 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:38.390348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111c375-a9c4-4b1a-adc4-967b3e650154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:38.391018 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c375-a9c4-4b1a-adc4-967b3e650154 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:38.391303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c375-a9c4-4b1a-adc4-967b3e650154 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:38.391580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c375-a9c4-4b1a-adc4-967b3e650154 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:38.392261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111c375-a9c4-4b1a-adc4-967b3e650154 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:38.393655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111c375-a9c4-4b1a-adc4-967b3e650154 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:38.400642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 495/992] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 20 05:55:38 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 05:55:38.430612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:38.491809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33206a85-c577-4bd5-a0e5-e2320bbbe4a6 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:38.527778 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80865-e8cf-4bf3-aca4-78a6fdedfbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:38.528497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80865-e8cf-4bf3-aca4-78a6fdedfbbb None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:38.528789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80865-e8cf-4bf3-aca4-78a6fdedfbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:38.529069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80865-e8cf-4bf3-aca4-78a6fdedfbbb None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:38.529811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f80865-e8cf-4bf3-aca4-78a6fdedfbbb None admin] RBAC: Adding query filter params (name=image) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:38.530116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f80865-e8cf-4bf3-aca4-78a6fdedfbbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:38.531518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f80865-e8cf-4bf3-aca4-78a6fdedfbbb None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:38.542089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 498/993] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:38.543771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111c375-a9c4-4b1a-adc4-967b3e650154 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:38.548685 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:38.651908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111c375-a9c4-4b1a-adc4-967b3e650154 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:38.686169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eecb5b-d5b7-4746-a13f-91ad94ffba14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:38.686832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eecb5b-d5b7-4746-a13f-91ad94ffba14 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:38.687117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eecb5b-d5b7-4746-a13f-91ad94ffba14 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:38.687392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eecb5b-d5b7-4746-a13f-91ad94ffba14 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:38.688097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eecb5b-d5b7-4746-a13f-91ad94ffba14 None admin] RBAC: Adding query filter params (type=image) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:38.688434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eecb5b-d5b7-4746-a13f-91ad94ffba14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:38.689805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eecb5b-d5b7-4746-a13f-91ad94ffba14 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:38.700414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 496/994] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:39.545106 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7292bbf-1268-4ed6-af36-4683021d1996 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:39.545594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7292bbf-1268-4ed6-af36-4683021d1996 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:39.545594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7292bbf-1268-4ed6-af36-4683021d1996 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:39.547075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 499/995] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:39.552003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab887c3-fa30-4854-878e-e29206febafd None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:39.552414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab887c3-fa30-4854-878e-e29206febafd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:39.552572 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab887c3-fa30-4854-878e-e29206febafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:39.569530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-bab887c3-fa30-4854-878e-e29206febafd None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:39.570716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bab887c3-fa30-4854-878e-e29206febafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:39.631165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:39.640609 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 497/996] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:39.658672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7292bbf-1268-4ed6-af36-4683021d1996 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:39.762813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7292bbf-1268-4ed6-af36-4683021d1996 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:39.772108 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:39.798599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a783f3-dca2-407d-b6d6-3a181068b3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:39.799324 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a783f3-dca2-407d-b6d6-3a181068b3dc None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:39.799606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a783f3-dca2-407d-b6d6-3a181068b3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:39.799883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a783f3-dca2-407d-b6d6-3a181068b3dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:39.800582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a783f3-dca2-407d-b6d6-3a181068b3dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:39.802028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a783f3-dca2-407d-b6d6-3a181068b3dc None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-b6a783f3-dca2-407d-b6d6-3a181068b3dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:39.814648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:39.815737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:55:39.816652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:39.820731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 500/997] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:39.821790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab887c3-fa30-4854-878e-e29206febafd None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:39.918642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab887c3-fa30-4854-878e-e29206febafd None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:39.952363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a3e0d-5865-40fd-a171-52c3b1b3f681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:39.953024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a3e0d-5865-40fd-a171-52c3b1b3f681 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:39.953304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a3e0d-5865-40fd-a171-52c3b1b3f681 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:39.953575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a3e0d-5865-40fd-a171-52c3b1b3f681 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:39.954275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a3e0d-5865-40fd-a171-52c3b1b3f681 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:39.954581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a3e0d-5865-40fd-a171-52c3b1b3f681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:39.955934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a3e0d-5865-40fd-a171-52c3b1b3f681 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:39.966068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 498/998] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:39.967255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a783f3-dca2-407d-b6d6-3a181068b3dc None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:40.074921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a783f3-dca2-407d-b6d6-3a181068b3dc None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:40.107807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d953caf-33c1-4eba-9842-291083ceef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:40.108502 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d953caf-33c1-4eba-9842-291083ceef1c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:40.108794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d953caf-33c1-4eba-9842-291083ceef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:40.109076 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d953caf-33c1-4eba-9842-291083ceef1c None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:40.109791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d953caf-33c1-4eba-9842-291083ceef1c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:40.110106 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d953caf-33c1-4eba-9842-291083ceef1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:40.111508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d953caf-33c1-4eba-9842-291083ceef1c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:40.121182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 501/999] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:40.124707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a3e0d-5865-40fd-a171-52c3b1b3f681 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:40.189272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:40.229224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a3e0d-5865-40fd-a171-52c3b1b3f681 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:40.269127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0834f-cd22-4f21-b091-ac62ad6c52da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:40.270173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0834f-cd22-4f21-b091-ac62ad6c52da None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:40.270680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0834f-cd22-4f21-b091-ac62ad6c52da None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:40.271154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0834f-cd22-4f21-b091-ac62ad6c52da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:40.272136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0834f-cd22-4f21-b091-ac62ad6c52da None admin] RBAC: Adding query filter params (interface=public, service_id=94cceee78cb44894bfd1cabdf7e4c443, region_id=RegionOne) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:40.272839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0834f-cd22-4f21-b091-ac62ad6c52da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:40.274436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0834f-cd22-4f21-b091-ac62ad6c52da None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:40.284376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 499/1000] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 20 05:55:40 2022] GET /identity/v3/endpoints?service_id=94cceee78cb44894bfd1cabdf7e4c443&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:40.285890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d953caf-33c1-4eba-9842-291083ceef1c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:40.324181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:40.391743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d953caf-33c1-4eba-9842-291083ceef1c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:40.426347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495e0c0-814b-4f58-9b8f-223e155357c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:40.427058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495e0c0-814b-4f58-9b8f-223e155357c8 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:40.427348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495e0c0-814b-4f58-9b8f-223e155357c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:40.427639 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495e0c0-814b-4f58-9b8f-223e155357c8 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:40.428386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495e0c0-814b-4f58-9b8f-223e155357c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:40.429796 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495e0c0-814b-4f58-9b8f-223e155357c8 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:40.436280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 502/1001] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 20 05:55:40 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 05:55:40.439815 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611bffe-1311-4237-b9ac-190570c85ee4 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:40.440105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611bffe-1311-4237-b9ac-190570c85ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:40.440412 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611bffe-1311-4237-b9ac-190570c85ee4 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:40.441995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 500/1002] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:40.448198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921347-416a-4a92-acd7-201e26162495 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:40.448535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921347-416a-4a92-acd7-201e26162495 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:40.448800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921347-416a-4a92-acd7-201e26162495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:40.467184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-02921347-416a-4a92-acd7-201e26162495 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:40.468445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-02921347-416a-4a92-acd7-201e26162495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:40.541607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 503/1003] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:40.565073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611bffe-1311-4237-b9ac-190570c85ee4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:40.672092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611bffe-1311-4237-b9ac-190570c85ee4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:40.698086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:40.707789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9330350-f7e6-44d7-9317-97af6bcc1287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:40.708656 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330350-f7e6-44d7-9317-97af6bcc1287 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:40.708939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330350-f7e6-44d7-9317-97af6bcc1287 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:40.709215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330350-f7e6-44d7-9317-97af6bcc1287 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:40.709861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9330350-f7e6-44d7-9317-97af6bcc1287 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:40.711225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9330350-f7e6-44d7-9317-97af6bcc1287 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e9330350-f7e6-44d7-9317-97af6bcc1287 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:40.723066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:40.724069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:40.724965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 501/1004] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jun 20 05:55:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:40.731653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02921347-416a-4a92-acd7-201e26162495 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:40.758846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4283f23-89bc-4b3b-8c6a-9543325db791 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:40.759183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4283f23-89bc-4b3b-8c6a-9543325db791 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:40.759413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4283f23-89bc-4b3b-8c6a-9543325db791 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:40.761082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 502/1005] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:40.762819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:40.765948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b279a-c211-4701-b26f-2d09f9d64c18 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:40.766237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b279a-c211-4701-b26f-2d09f9d64c18 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:40.766515 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b279a-c211-4701-b26f-2d09f9d64c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:40.783369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f77b279a-c211-4701-b26f-2d09f9d64c18 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:40.784602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f77b279a-c211-4701-b26f-2d09f9d64c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:40.837100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02921347-416a-4a92-acd7-201e26162495 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:40.853433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 503/1006] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:40.872883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a50578-90bd-4516-bd6d-4cd74b877efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:40.873548 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a50578-90bd-4516-bd6d-4cd74b877efa None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:40.873950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a50578-90bd-4516-bd6d-4cd74b877efa None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:40.874230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a50578-90bd-4516-bd6d-4cd74b877efa None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:40.875039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a50578-90bd-4516-bd6d-4cd74b877efa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:40.875313 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a50578-90bd-4516-bd6d-4cd74b877efa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:40.875952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b279a-c211-4701-b26f-2d09f9d64c18 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:40.876722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a50578-90bd-4516-bd6d-4cd74b877efa None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:40.882888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 504/1007] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 20 05:55:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:40.888230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a50578-90bd-4516-bd6d-4cd74b877efa None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:40.979757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b279a-c211-4701-b26f-2d09f9d64c18 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:40.984897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:40.992085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a50578-90bd-4516-bd6d-4cd74b877efa None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:41.002947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:41.019100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030db37-7df5-44f1-94de-a5d568792dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:41.019777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030db37-7df5-44f1-94de-a5d568792dec None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:41.020062 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030db37-7df5-44f1-94de-a5d568792dec None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:41.020375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030db37-7df5-44f1-94de-a5d568792dec None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:41.021186 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030db37-7df5-44f1-94de-a5d568792dec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:41.022558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030db37-7df5-44f1-94de-a5d568792dec None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:41.029502 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e5229-16ec-4398-a0d1-6f6363e19032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:41.030268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e5229-16ec-4398-a0d1-6f6363e19032 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:41.030578 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e5229-16ec-4398-a0d1-6f6363e19032 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:41.030860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e5229-16ec-4398-a0d1-6f6363e19032 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:41.031648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e5229-16ec-4398-a0d1-6f6363e19032 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:41.031961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e5229-16ec-4398-a0d1-6f6363e19032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:41.033351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e5229-16ec-4398-a0d1-6f6363e19032 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:41.047468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 504/1008] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:55:40 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:55:41.047722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 505/1009] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jun 20 05:55:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:41.047815 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030db37-7df5-44f1-94de-a5d568792dec None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:41.166771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030db37-7df5-44f1-94de-a5d568792dec None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:41.207012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d5165-35aa-4133-a2eb-e0eea532ba7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:41.207675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d5165-35aa-4133-a2eb-e0eea532ba7c None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:41.208527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d5165-35aa-4133-a2eb-e0eea532ba7c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:41.208806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d5165-35aa-4133-a2eb-e0eea532ba7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:41.209560 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d5165-35aa-4133-a2eb-e0eea532ba7c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:41.210915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409d5165-35aa-4133-a2eb-e0eea532ba7c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:41.226957 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 505/1010] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 20 05:55:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:55:42.483601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76fba-d6c9-41b4-b0fd-55a8b73da5dd None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:42.484116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76fba-d6c9-41b4-b0fd-55a8b73da5dd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:42.484194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa76fba-d6c9-41b4-b0fd-55a8b73da5dd None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:42.485770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 506/1011] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:42.490765 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66444f3a-9390-4c81-be06-eefcc5289f0a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:42.491146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66444f3a-9390-4c81-be06-eefcc5289f0a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:42.491330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66444f3a-9390-4c81-be06-eefcc5289f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:42.508629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-66444f3a-9390-4c81-be06-eefcc5289f0a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:42.509821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-66444f3a-9390-4c81-be06-eefcc5289f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:42.538504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:42.584937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 506/1012] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:42 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:42.607844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa76fba-d6c9-41b4-b0fd-55a8b73da5dd None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:42.708927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa76fba-d6c9-41b4-b0fd-55a8b73da5dd None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:42.743312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bc135-2211-4cb2-9656-c231428255ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:42.744031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bc135-2211-4cb2-9656-c231428255ce None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:42.744346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bc135-2211-4cb2-9656-c231428255ce None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:42.744625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bc135-2211-4cb2-9656-c231428255ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:42.745280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bc135-2211-4cb2-9656-c231428255ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:42.746646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bc135-2211-4cb2-9656-c231428255ce None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-862bc135-2211-4cb2-9656-c231428255ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:42.758515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:42.759508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 05:55:42.760420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:42.764843 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 507/1013] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:42.765813 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66444f3a-9390-4c81-be06-eefcc5289f0a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:42.865417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66444f3a-9390-4c81-be06-eefcc5289f0a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:42.899469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b410b-8b89-43a0-b180-8aa8488a4e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:42.900137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b410b-8b89-43a0-b180-8aa8488a4e78 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:42.900710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b410b-8b89-43a0-b180-8aa8488a4e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:42.900995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b410b-8b89-43a0-b180-8aa8488a4e78 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:42.901706 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b410b-8b89-43a0-b180-8aa8488a4e78 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:42.902022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b410b-8b89-43a0-b180-8aa8488a4e78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:42.903396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b410b-8b89-43a0-b180-8aa8488a4e78 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:42.908531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 507/1014] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:42.914164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bc135-2211-4cb2-9656-c231428255ce None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:42.939255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:43.016969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bc135-2211-4cb2-9656-c231428255ce None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:43.051209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20cfe1d-4add-4936-8b04-0e8a424a064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:43.051900 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cfe1d-4add-4936-8b04-0e8a424a064f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.052191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cfe1d-4add-4936-8b04-0e8a424a064f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.052514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20cfe1d-4add-4936-8b04-0e8a424a064f None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.053237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cfe1d-4add-4936-8b04-0e8a424a064f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:43.053552 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cfe1d-4add-4936-8b04-0e8a424a064f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:43.054927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20cfe1d-4add-4936-8b04-0e8a424a064f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:43.064468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 508/1015] 10.222.0.13 () {56 vars in 1112 bytes} [Mon Jun 20 05:55:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:43.065560 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b410b-8b89-43a0-b180-8aa8488a4e78 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:43.093175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:43.113154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51217efb-04bc-4b84-95d2-247efc635b79 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.113481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51217efb-04bc-4b84-95d2-247efc635b79 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.113731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51217efb-04bc-4b84-95d2-247efc635b79 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.115121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 509/1016] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:43.120216 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2befe5-1822-482c-8051-642f13264d66 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.120541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2befe5-1822-482c-8051-642f13264d66 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.120827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2befe5-1822-482c-8051-642f13264d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.138107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-bd2befe5-1822-482c-8051-642f13264d66 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:43.139310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-bd2befe5-1822-482c-8051-642f13264d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:43.170626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b410b-8b89-43a0-b180-8aa8488a4e78 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:43.206707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54bbbd-a14b-4916-858c-0b2fb32c30c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:43.207363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54bbbd-a14b-4916-858c-0b2fb32c30c8 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.207641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54bbbd-a14b-4916-858c-0b2fb32c30c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.208548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54bbbd-a14b-4916-858c-0b2fb32c30c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.209280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54bbbd-a14b-4916-858c-0b2fb32c30c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:43.210640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54bbbd-a14b-4916-858c-0b2fb32c30c8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:43.214252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 510/1017] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:43 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:43.230505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 508/1018] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 20 05:55:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:55:43.245249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2befe5-1822-482c-8051-642f13264d66 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:43.266082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:43.275632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fc951-6c67-4b09-8afe-4729f8fdb1e8 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.275846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fc951-6c67-4b09-8afe-4729f8fdb1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.276125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fc951-6c67-4b09-8afe-4729f8fdb1e8 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.277704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 509/1019] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:43.283163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d0b3f-daac-4b41-94be-b19c63dba197 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.283453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d0b3f-daac-4b41-94be-b19c63dba197 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.283751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d0b3f-daac-4b41-94be-b19c63dba197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.301405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-406d0b3f-daac-4b41-94be-b19c63dba197 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:43.302689 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-406d0b3f-daac-4b41-94be-b19c63dba197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:43.366879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2befe5-1822-482c-8051-642f13264d66 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:43.386324 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 510/1020] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:43.406229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cc260-c7be-45f9-9bb3-ce5c22ea2ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:43.407011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc260-c7be-45f9-9bb3-ce5c22ea2ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.407300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc260-c7be-45f9-9bb3-ce5c22ea2ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.407576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc260-c7be-45f9-9bb3-ce5c22ea2ee7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.408230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cc260-c7be-45f9-9bb3-ce5c22ea2ee7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:43.409625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cc260-c7be-45f9-9bb3-ce5c22ea2ee7 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:43.410704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d0b3f-daac-4b41-94be-b19c63dba197 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-a13cc260-c7be-45f9-9bb3-ce5c22ea2ee7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:43.421759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:43.422784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:43.423633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 511/1021] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Jun 20 05:55:43 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:43.424491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:43.429342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cc260-c7be-45f9-9bb3-ce5c22ea2ee7 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:43.524739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:43.525624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d0b3f-daac-4b41-94be-b19c63dba197 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:43.548129 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cc260-c7be-45f9-9bb3-ce5c22ea2ee7 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:43.565127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef8563-8871-405c-89f0-c2e3a55d32e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:43.565922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef8563-8871-405c-89f0-c2e3a55d32e7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.566213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef8563-8871-405c-89f0-c2e3a55d32e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.566489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef8563-8871-405c-89f0-c2e3a55d32e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.567835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef8563-8871-405c-89f0-c2e3a55d32e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:43.569308 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef8563-8871-405c-89f0-c2e3a55d32e7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:43.571127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 511/1022] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:43.576567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef8563-8871-405c-89f0-c2e3a55d32e7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:43.586213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7df99-cd3f-4bd5-bedb-997cf9a84602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:43.586913 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7df99-cd3f-4bd5-bedb-997cf9a84602 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.587200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7df99-cd3f-4bd5-bedb-997cf9a84602 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.587833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7df99-cd3f-4bd5-bedb-997cf9a84602 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.588593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7df99-cd3f-4bd5-bedb-997cf9a84602 None admin] RBAC: Adding query filter params (name=image) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:43.589222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7df99-cd3f-4bd5-bedb-997cf9a84602 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:43.590596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7df99-cd3f-4bd5-bedb-997cf9a84602 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:43.595904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 512/1023] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:43.601962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7df99-cd3f-4bd5-bedb-997cf9a84602 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:43.662877 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:43.691379 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef8563-8871-405c-89f0-c2e3a55d32e7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:43.707848 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7df99-cd3f-4bd5-bedb-997cf9a84602 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:43.732000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6867a-ff8f-4290-adf3-dd176e8650f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:43.732856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6867a-ff8f-4290-adf3-dd176e8650f1 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.733146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6867a-ff8f-4290-adf3-dd176e8650f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.733426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6867a-ff8f-4290-adf3-dd176e8650f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.734131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6867a-ff8f-4290-adf3-dd176e8650f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:43.735550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6867a-ff8f-4290-adf3-dd176e8650f1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:43.747761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad959d-6f15-4b30-932a-33af209124a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:43.748287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad959d-6f15-4b30-932a-33af209124a5 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.748611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad959d-6f15-4b30-932a-33af209124a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.748951 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad959d-6f15-4b30-932a-33af209124a5 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.749611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad959d-6f15-4b30-932a-33af209124a5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:43.749924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad959d-6f15-4b30-932a-33af209124a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:43.751302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad959d-6f15-4b30-932a-33af209124a5 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:43.757713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 513/1024] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:43.763575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad959d-6f15-4b30-932a-33af209124a5 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:43.768998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 512/1025] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:55:43 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:55:43.776019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:43.878145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad959d-6f15-4b30-932a-33af209124a5 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:43.915130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7426d2-f2d5-4103-b640-352b326f6da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:43.915801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7426d2-f2d5-4103-b640-352b326f6da0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:43.916091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7426d2-f2d5-4103-b640-352b326f6da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:43.916399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7426d2-f2d5-4103-b640-352b326f6da0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:43.917207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7426d2-f2d5-4103-b640-352b326f6da0 None admin] RBAC: Adding query filter params (interface=public, service_id=710b130517194287b4565e9e41f2e4d7, region_id=RegionOne) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:43.917524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7426d2-f2d5-4103-b640-352b326f6da0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:43.919036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7426d2-f2d5-4103-b640-352b326f6da0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:43.925183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 514/1026] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 20 05:55:43 2022] GET /identity/v3/endpoints?service_id=710b130517194287b4565e9e41f2e4d7&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:43.931037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6867a-ff8f-4290-adf3-dd176e8650f1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:44.036960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6867a-ff8f-4290-adf3-dd176e8650f1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:44.064325 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:44.073912 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dca198-ca54-4f75-872c-ad56a46c961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:44.074580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dca198-ca54-4f75-872c-ad56a46c961b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:44.074865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dca198-ca54-4f75-872c-ad56a46c961b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:44.075145 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dca198-ca54-4f75-872c-ad56a46c961b None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:44.075830 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dca198-ca54-4f75-872c-ad56a46c961b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:44.077226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dca198-ca54-4f75-872c-ad56a46c961b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:44.092422 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 513/1027] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 20 05:55:43 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:55:45.394246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5642-aba2-4078-926b-a1aa2dbd5b66 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:45.394833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5642-aba2-4078-926b-a1aa2dbd5b66 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:45.394833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5642-aba2-4078-926b-a1aa2dbd5b66 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:45.396249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 515/1028] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:45.401582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502cb61-1609-421c-be44-54e576e0a1d7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:45.402022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502cb61-1609-421c-be44-54e576e0a1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:45.402116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502cb61-1609-421c-be44-54e576e0a1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:45.419507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3502cb61-1609-421c-be44-54e576e0a1d7 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:45.420726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3502cb61-1609-421c-be44-54e576e0a1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:45.488481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 514/1029] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:45.511986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc5642-aba2-4078-926b-a1aa2dbd5b66 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:45.584064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:45.617006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc5642-aba2-4078-926b-a1aa2dbd5b66 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:45.651904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10461f3-a0aa-447e-8019-22cf4030f254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:45.652740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10461f3-a0aa-447e-8019-22cf4030f254 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:45.653024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10461f3-a0aa-447e-8019-22cf4030f254 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:45.653298 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10461f3-a0aa-447e-8019-22cf4030f254 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:45.664344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10461f3-a0aa-447e-8019-22cf4030f254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-c10461f3-a0aa-447e-8019-22cf4030f254 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:45.672331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:45.673306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:45.674207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:45.677213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 516/1030] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 20 05:55:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:45.680044 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502cb61-1609-421c-be44-54e576e0a1d7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:45.780736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502cb61-1609-421c-be44-54e576e0a1d7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:45.803738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:45.816031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b14f4-4939-4924-9079-76af476b24b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:45.816742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b14f4-4939-4924-9079-76af476b24b9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:45.817032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b14f4-4939-4924-9079-76af476b24b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:45.817338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b14f4-4939-4924-9079-76af476b24b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:45.818089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b14f4-4939-4924-9079-76af476b24b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:45.818406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b14f4-4939-4924-9079-76af476b24b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:45.819776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b14f4-4939-4924-9079-76af476b24b9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:45.832451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 515/1031] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 20 05:55:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:45.834173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10461f3-a0aa-447e-8019-22cf4030f254 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:45.896366 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e79ff-4e2e-4a1e-971a-fcca586c4d55 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:45.896669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e79ff-4e2e-4a1e-971a-fcca586c4d55 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:45.896939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e79ff-4e2e-4a1e-971a-fcca586c4d55 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:45.898434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 516/1032] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:45.903419 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a71bc3-f29e-4ed7-8f00-72be54e2c8f1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:45.903708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a71bc3-f29e-4ed7-8f00-72be54e2c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:45.903984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a71bc3-f29e-4ed7-8f00-72be54e2c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:45.920856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-34a71bc3-f29e-4ed7-8f00-72be54e2c8f1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:45.922039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-34a71bc3-f29e-4ed7-8f00-72be54e2c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:45.935916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10461f3-a0aa-447e-8019-22cf4030f254 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:45.969668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:45.976353 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b7d57-8a6e-49d3-8832-e47d77b3008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:45.977130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b7d57-8a6e-49d3-8832-e47d77b3008c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:45.977421 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b7d57-8a6e-49d3-8832-e47d77b3008c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:45.977701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b7d57-8a6e-49d3-8832-e47d77b3008c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:45.988098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b7d57-8a6e-49d3-8832-e47d77b3008c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:45.990118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b7d57-8a6e-49d3-8832-e47d77b3008c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:45.995488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 517/1033] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-ef7b7d57-8a6e-49d3-8832-e47d77b3008c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:46.007827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:46.008822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:46.009718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:46.009718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:46.009718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:46.009718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:46.012655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 517/1034] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:46.014538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a71bc3-f29e-4ed7-8f00-72be54e2c8f1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:46.019587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b7d57-8a6e-49d3-8832-e47d77b3008c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:46.122679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a71bc3-f29e-4ed7-8f00-72be54e2c8f1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:46.124240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b7d57-8a6e-49d3-8832-e47d77b3008c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:46.137104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:46.157099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275d3b0-4356-43f4-aa02-b29329f9f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:46.157581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9bf58-810f-41f2-9bce-d1051b4f6c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:46.157877 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d3b0-4356-43f4-aa02-b29329f9f9ac None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.158157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d3b0-4356-43f4-aa02-b29329f9f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.158262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9bf58-810f-41f2-9bce-d1051b4f6c60 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.158437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d3b0-4356-43f4-aa02-b29329f9f9ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.158546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9bf58-810f-41f2-9bce-d1051b4f6c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.158799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9bf58-810f-41f2-9bce-d1051b4f6c60 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.159520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9bf58-810f-41f2-9bce-d1051b4f6c60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:46.159622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275d3b0-4356-43f4-aa02-b29329f9f9ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:46.159831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9bf58-810f-41f2-9bce-d1051b4f6c60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:46.161540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275d3b0-4356-43f4-aa02-b29329f9f9ac None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:46.161753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9bf58-810f-41f2-9bce-d1051b4f6c60 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:46.163300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 518/1035] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:46.164297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0293d-baef-4348-9f93-7320fc90f7ca None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.164609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0293d-baef-4348-9f93-7320fc90f7ca None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.164878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0293d-baef-4348-9f93-7320fc90f7ca None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.166132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 519/1036] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:46.169159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0293d-baef-4348-9f93-7320fc90f7ca None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:46.177568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 518/1037] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:46.178955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e3922-8b08-4f3a-99b8-c25980878a2f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.179253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e3922-8b08-4f3a-99b8-c25980878a2f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.179536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e3922-8b08-4f3a-99b8-c25980878a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.196383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-747e3922-8b08-4f3a-99b8-c25980878a2f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:46.197580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-747e3922-8b08-4f3a-99b8-c25980878a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:46.222950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:46.267883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 519/1038] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:46.268755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e3922-8b08-4f3a-99b8-c25980878a2f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:46.277050 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0293d-baef-4348-9f93-7320fc90f7ca None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:46.310167 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508ff3-ab7c-46e1-9c3e-564a34a26058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:46.310839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508ff3-ab7c-46e1-9c3e-564a34a26058 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.311124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508ff3-ab7c-46e1-9c3e-564a34a26058 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.311402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508ff3-ab7c-46e1-9c3e-564a34a26058 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.312106 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa508ff3-ab7c-46e1-9c3e-564a34a26058 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:46.313579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa508ff3-ab7c-46e1-9c3e-564a34a26058 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:46.336025 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 520/1039] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:55:46 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:55:46.336851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508ff3-ab7c-46e1-9c3e-564a34a26058 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:46.376269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e3922-8b08-4f3a-99b8-c25980878a2f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:46.378583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:46.415203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfd71b-2926-4187-a63e-91310e9fa67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:46.416046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfd71b-2926-4187-a63e-91310e9fa67a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.416293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfd71b-2926-4187-a63e-91310e9fa67a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.416595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bfd71b-2926-4187-a63e-91310e9fa67a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.424715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfd71b-2926-4187-a63e-91310e9fa67a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:46.426187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bfd71b-2926-4187-a63e-91310e9fa67a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a9bfd71b-2926-4187-a63e-91310e9fa67a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:46.441402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:46.443239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:46.444631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:46.444631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:46.444631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:46.444631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:46.444631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:46.444631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:46.444631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:46.444631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:46.444631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:46.444631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:46.444631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 520/1040] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 20 05:55:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:46.449066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfd71b-2926-4187-a63e-91310e9fa67a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:46.463351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508ff3-ab7c-46e1-9c3e-564a34a26058 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:46.477466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:46.509270 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6aff7-73b1-4e9f-b93e-72151ba3c442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:46.510069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6aff7-73b1-4e9f-b93e-72151ba3c442 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.510362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6aff7-73b1-4e9f-b93e-72151ba3c442 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.510641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6aff7-73b1-4e9f-b93e-72151ba3c442 None admin] PATH_INFO: `/v3/services/image` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.511312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6aff7-73b1-4e9f-b93e-72151ba3c442 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:46.512741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6aff7-73b1-4e9f-b93e-72151ba3c442 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-73b6aff7-73b1-4e9f-b93e-72151ba3c442 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:46.526823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:46.528090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:46.529145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 521/1041] 10.222.0.13 () {56 vars in 1105 bytes} [Mon Jun 20 05:55:46 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:46.534011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6aff7-73b1-4e9f-b93e-72151ba3c442 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:46.572095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bfd71b-2926-4187-a63e-91310e9fa67a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:46.607714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f54fe8-e44e-4670-a140-fc0392880120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:46.608517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f54fe8-e44e-4670-a140-fc0392880120 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.608803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f54fe8-e44e-4670-a140-fc0392880120 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.609187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f54fe8-e44e-4670-a140-fc0392880120 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.610023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f54fe8-e44e-4670-a140-fc0392880120 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:46.610331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f54fe8-e44e-4670-a140-fc0392880120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:46.611760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f54fe8-e44e-4670-a140-fc0392880120 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:46.636623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 521/1042] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 20 05:55:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:46.637539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f54fe8-e44e-4670-a140-fc0392880120 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:46.639895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6aff7-73b1-4e9f-b93e-72151ba3c442 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:46.662381 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:46.675095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d5bdb-bc20-4601-899d-5931ee00b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:46.675765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5bdb-bc20-4601-899d-5931ee00b2cf None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.676053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5bdb-bc20-4601-899d-5931ee00b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.676909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d5bdb-bc20-4601-899d-5931ee00b2cf None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.677610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d5bdb-bc20-4601-899d-5931ee00b2cf None admin] RBAC: Adding query filter params (name=image) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:46.677925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d5bdb-bc20-4601-899d-5931ee00b2cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:46.679305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d5bdb-bc20-4601-899d-5931ee00b2cf None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:46.684494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 522/1043] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:46.689709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d5bdb-bc20-4601-899d-5931ee00b2cf None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:46.724509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:46.743228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f54fe8-e44e-4670-a140-fc0392880120 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:46.778383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdb743-397a-4219-9706-cecf1a52324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:46.779028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdb743-397a-4219-9706-cecf1a52324b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.779306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdb743-397a-4219-9706-cecf1a52324b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.779578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdb743-397a-4219-9706-cecf1a52324b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.791373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d5bdb-bc20-4601-899d-5931ee00b2cf None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:46.826491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281f2af-88d6-440d-9e95-342214d4c6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:46.827161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f2af-88d6-440d-9e95-342214d4c6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.827452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f2af-88d6-440d-9e95-342214d4c6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.827736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f2af-88d6-440d-9e95-342214d4c6f2 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.828490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281f2af-88d6-440d-9e95-342214d4c6f2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:46.828808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281f2af-88d6-440d-9e95-342214d4c6f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:46.830277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281f2af-88d6-440d-9e95-342214d4c6f2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:46.840137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 523/1044] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:46.841195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281f2af-88d6-440d-9e95-342214d4c6f2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:46.858273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdb743-397a-4219-9706-cecf1a52324b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:46.860202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdb743-397a-4219-9706-cecf1a52324b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:46.886369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:46.948697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:46.951590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281f2af-88d6-440d-9e95-342214d4c6f2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:46.971094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 522/1045] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:46 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:55:46.972217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdb743-397a-4219-9706-cecf1a52324b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:46.988148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0be86-189d-414d-bf13-f576bbf96ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:46.989154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0be86-189d-414d-bf13-f576bbf96ffe None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:46.989437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0be86-189d-414d-bf13-f576bbf96ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:46.989706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0be86-189d-414d-bf13-f576bbf96ffe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:46.990429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0be86-189d-414d-bf13-f576bbf96ffe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:46.991791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0be86-189d-414d-bf13-f576bbf96ffe None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:47.011149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 524/1046] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 20 05:55:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:55:47.084143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdb743-397a-4219-9706-cecf1a52324b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:47.109563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:47.129175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eff0a-6a1b-4d5d-ba90-d1f789fb7127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:47.130523 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eff0a-6a1b-4d5d-ba90-d1f789fb7127 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:47.130812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eff0a-6a1b-4d5d-ba90-d1f789fb7127 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:47.131090 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eff0a-6a1b-4d5d-ba90-d1f789fb7127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:47.143719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4eff0a-6a1b-4d5d-ba90-d1f789fb7127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:47.145900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4eff0a-6a1b-4d5d-ba90-d1f789fb7127 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-5c4eff0a-6a1b-4d5d-ba90-d1f789fb7127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:47.167538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:47.168525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:47.169451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:47.169451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:47.169451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:47.169451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:47.169451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 523/1047] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:47.174474 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0be86-189d-414d-bf13-f576bbf96ffe None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:47.284536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0be86-189d-414d-bf13-f576bbf96ffe None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:47.318878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21bd4-f84a-429f-833c-8b16be251188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:47.319535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21bd4-f84a-429f-833c-8b16be251188 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:47.319852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21bd4-f84a-429f-833c-8b16be251188 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:47.320130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21bd4-f84a-429f-833c-8b16be251188 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:47.320878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b21bd4-f84a-429f-833c-8b16be251188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:47.321185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b21bd4-f84a-429f-833c-8b16be251188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:47.322536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b21bd4-f84a-429f-833c-8b16be251188 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:47.339053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 525/1048] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:47.340679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eff0a-6a1b-4d5d-ba90-d1f789fb7127 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:47.443383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eff0a-6a1b-4d5d-ba90-d1f789fb7127 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:47.481714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145b47e-4d33-4452-b01b-b1b3c0135379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:47.482512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b47e-4d33-4452-b01b-b1b3c0135379 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:47.482798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b47e-4d33-4452-b01b-b1b3c0135379 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:47.483073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145b47e-4d33-4452-b01b-b1b3c0135379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:47.491256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145b47e-4d33-4452-b01b-b1b3c0135379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:47.492690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145b47e-4d33-4452-b01b-b1b3c0135379 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a145b47e-4d33-4452-b01b-b1b3c0135379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:47.510733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:47.511720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:47.512663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:47.512663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:47.512663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:47.512663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:47.512663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:47.512663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:47.512663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:47.512663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:47.516636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 524/1049] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:47.517934 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21bd4-f84a-429f-833c-8b16be251188 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:47.537178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:47.623727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21bd4-f84a-429f-833c-8b16be251188 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:47.657916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42931d-e0c4-4591-89fe-47f8992488ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:47.658574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42931d-e0c4-4591-89fe-47f8992488ef None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:47.658860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42931d-e0c4-4591-89fe-47f8992488ef None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:47.659139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42931d-e0c4-4591-89fe-47f8992488ef None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:47.659928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42931d-e0c4-4591-89fe-47f8992488ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:47.660240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42931d-e0c4-4591-89fe-47f8992488ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:47.662277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42931d-e0c4-4591-89fe-47f8992488ef None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:47.676511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 526/1050] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:47.680591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145b47e-4d33-4452-b01b-b1b3c0135379 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:47.712950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:47.785326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145b47e-4d33-4452-b01b-b1b3c0135379 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:47.819488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b492dc1-1734-45f4-8d0c-df73060becf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:47.820143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b492dc1-1734-45f4-8d0c-df73060becf7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:47.820462 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b492dc1-1734-45f4-8d0c-df73060becf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:47.820744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b492dc1-1734-45f4-8d0c-df73060becf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:47.821572 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b492dc1-1734-45f4-8d0c-df73060becf7 None admin] RBAC: Adding query filter params (role.id=74cbcc96b8814e84a977b222c3575a05, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=cbe8aea409c3459f9f7b3c3ef6ff583b) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:47.821890 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b492dc1-1734-45f4-8d0c-df73060becf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:47.823318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b492dc1-1734-45f4-8d0c-df73060becf7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:47.829087 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 525/1051] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:47 2022] GET /identity/v3/role_assignments?user.id=cbe8aea409c3459f9f7b3c3ef6ff583b&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=74cbcc96b8814e84a977b222c3575a05 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:48.441432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d5216-da7a-49ac-b251-f025dfd6c05e None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:48.441808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d5216-da7a-49ac-b251-f025dfd6c05e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:48.442534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d5216-da7a-49ac-b251-f025dfd6c05e None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:48.444062 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 527/1052] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:48.448957 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15f8d0-6948-49a0-b2ce-c1e7755c4df9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:48.449409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15f8d0-6948-49a0-b2ce-c1e7755c4df9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:48.449589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15f8d0-6948-49a0-b2ce-c1e7755c4df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:48.465917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-bd15f8d0-6948-49a0-b2ce-c1e7755c4df9 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:48.467103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bd15f8d0-6948-49a0-b2ce-c1e7755c4df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:48.544876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 526/1053] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:48.567972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d5216-da7a-49ac-b251-f025dfd6c05e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:48.645049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:48.670069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d5216-da7a-49ac-b251-f025dfd6c05e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:48.705130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cb990-a8b0-4c54-bf09-541aa2bd0829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:48.705919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cb990-a8b0-4c54-bf09-541aa2bd0829 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:48.706201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cb990-a8b0-4c54-bf09-541aa2bd0829 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:48.706476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cb990-a8b0-4c54-bf09-541aa2bd0829 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:48.717002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64cb990-a8b0-4c54-bf09-541aa2bd0829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-a64cb990-a8b0-4c54-bf09-541aa2bd0829 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:48.725091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:48.726047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:48.726906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:48.731312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 528/1054] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:48.732130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15f8d0-6948-49a0-b2ce-c1e7755c4df9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:48.756872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:48.838633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15f8d0-6948-49a0-b2ce-c1e7755c4df9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:48.872303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6caca5-f448-48f7-8ef1-874d122fee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:48.873028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6caca5-f448-48f7-8ef1-874d122fee2f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:48.873312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6caca5-f448-48f7-8ef1-874d122fee2f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:48.873584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6caca5-f448-48f7-8ef1-874d122fee2f None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:48.874318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6caca5-f448-48f7-8ef1-874d122fee2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:48.874623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6caca5-f448-48f7-8ef1-874d122fee2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:48.875980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6caca5-f448-48f7-8ef1-874d122fee2f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:48.888629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 527/1055] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:55:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:48.890353 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cb990-a8b0-4c54-bf09-541aa2bd0829 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:48.995875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cb990-a8b0-4c54-bf09-541aa2bd0829 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:49.030162 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9caa67-7e46-46de-ba56-43e82d1e1f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:49.031038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9caa67-7e46-46de-ba56-43e82d1e1f5b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:49.031319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9caa67-7e46-46de-ba56-43e82d1e1f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:49.031592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9caa67-7e46-46de-ba56-43e82d1e1f5b None admin] PATH_INFO: `/v3/users/c94a11b08e8f458c9b326b707dd6a6a6` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:49.034315 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:49.046547 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9caa67-7e46-46de-ba56-43e82d1e1f5b None admin] RBAC: Authorizing `identity:get_user(user_id=c94a11b08e8f458c9b326b707dd6a6a6)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:49.048073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9caa67-7e46-46de-ba56-43e82d1e1f5b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:49.054651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 529/1056] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:55:48 2022] GET /identity/v3/users/c94a11b08e8f458c9b326b707dd6a6a6 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:49.055600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6caca5-f448-48f7-8ef1-874d122fee2f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:49.060211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07f4f-99cd-448f-9cd8-3db9746a0ed2 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:49.060529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07f4f-99cd-448f-9cd8-3db9746a0ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:49.060813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07f4f-99cd-448f-9cd8-3db9746a0ed2 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:49.062244 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 530/1057] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:55:49.066780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0d32-b81d-4731-b87e-7cd2986a9880 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:49.067097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0d32-b81d-4731-b87e-7cd2986a9880 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:49.067375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0d32-b81d-4731-b87e-7cd2986a9880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:49.084151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-812b0d32-b81d-4731-b87e-7cd2986a9880 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:49.085451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-812b0d32-b81d-4731-b87e-7cd2986a9880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:49.152428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:49.161642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 531/1058] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:49.168729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6caca5-f448-48f7-8ef1-874d122fee2f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:49.183384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0d32-b81d-4731-b87e-7cd2986a9880 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:49.204598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b1154-034c-4bd3-a31a-5dba70a0170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:49.205225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1154-034c-4bd3-a31a-5dba70a0170f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:49.205509 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1154-034c-4bd3-a31a-5dba70a0170f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:49.205787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1154-034c-4bd3-a31a-5dba70a0170f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:49.278832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b1154-034c-4bd3-a31a-5dba70a0170f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:49.280293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b1154-034c-4bd3-a31a-5dba70a0170f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:49.295074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0d32-b81d-4731-b87e-7cd2986a9880 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:49.320262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:49.333157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e326d-3cfc-4291-abb2-48bdbfe9b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:49.333813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e326d-3cfc-4291-abb2-48bdbfe9b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:49.334100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e326d-3cfc-4291-abb2-48bdbfe9b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:49.334825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e326d-3cfc-4291-abb2-48bdbfe9b1b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:49.367209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:49.383651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 528/1059] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:55:49.389094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b1154-034c-4bd3-a31a-5dba70a0170f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:49.409633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e326d-3cfc-4291-abb2-48bdbfe9b1b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:49.412022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e326d-3cfc-4291-abb2-48bdbfe9b1b0 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:49.494125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b1154-034c-4bd3-a31a-5dba70a0170f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:49.521885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 532/1060] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:55:49.527701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e326d-3cfc-4291-abb2-48bdbfe9b1b0 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:49.531104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526a142-8a30-41ba-a2ac-f74d4dd804ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:49.531959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a142-8a30-41ba-a2ac-f74d4dd804ac None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:49.532244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a142-8a30-41ba-a2ac-f74d4dd804ac None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:49.532548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526a142-8a30-41ba-a2ac-f74d4dd804ac None admin] PATH_INFO: `/v3/projects/c40348c0a6a84c648288217ca61b121d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:49.533732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526a142-8a30-41ba-a2ac-f74d4dd804ac None admin] RBAC: Authorizing `identity:get_project(project_id=c40348c0a6a84c648288217ca61b121d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:49.535175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526a142-8a30-41ba-a2ac-f74d4dd804ac None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:49.537119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 529/1061] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:55:49 2022] GET /identity/v3/projects/c40348c0a6a84c648288217ca61b121d => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:49.542733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526a142-8a30-41ba-a2ac-f74d4dd804ac None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:49.559371 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:49.600871 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:49.644331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e326d-3cfc-4291-abb2-48bdbfe9b1b0 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:49.650821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526a142-8a30-41ba-a2ac-f74d4dd804ac None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:49.680225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382d6cb-33e3-407d-b1ae-70ff6ca297da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:49.680978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d6cb-33e3-407d-b1ae-70ff6ca297da None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:49.681268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d6cb-33e3-407d-b1ae-70ff6ca297da None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:49.681546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382d6cb-33e3-407d-b1ae-70ff6ca297da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:49.689469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e91eb-53ef-4099-ab55-6ec6b6dae176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:49.690339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e91eb-53ef-4099-ab55-6ec6b6dae176 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:49.690625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e91eb-53ef-4099-ab55-6ec6b6dae176 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:49.690908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e91eb-53ef-4099-ab55-6ec6b6dae176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:49.691733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e91eb-53ef-4099-ab55-6ec6b6dae176 None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=c40348c0a6a84c648288217ca61b121d, user.id=c94a11b08e8f458c9b326b707dd6a6a6) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:49.692055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e91eb-53ef-4099-ab55-6ec6b6dae176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:49.692821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382d6cb-33e3-407d-b1ae-70ff6ca297da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:49.693599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e91eb-53ef-4099-ab55-6ec6b6dae176 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:49.694281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382d6cb-33e3-407d-b1ae-70ff6ca297da None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:49.708342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 530/1062] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:49 2022] GET /identity/v3/role_assignments?user.id=c94a11b08e8f458c9b326b707dd6a6a6&scope.project.id=c40348c0a6a84c648288217ca61b121d&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-8382d6cb-33e3-407d-b1ae-70ff6ca297da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:49.720869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:49.721852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:49.722784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:49.722784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:49.722784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:49.722784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:49.722784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 533/1063] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:49.729702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e91eb-53ef-4099-ab55-6ec6b6dae176 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:49.837460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50456-6f60-4f7d-9ac1-1dc6a2de0b70 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:49.837755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50456-6f60-4f7d-9ac1-1dc6a2de0b70 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:49.838035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a50456-6f60-4f7d-9ac1-1dc6a2de0b70 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:49.839440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 534/1064] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:49.841185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e91eb-53ef-4099-ab55-6ec6b6dae176 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:49.844964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215033ba-f2ba-4bdd-b025-c3743af98d78 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:49.845431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215033ba-f2ba-4bdd-b025-c3743af98d78 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:49.845771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215033ba-f2ba-4bdd-b025-c3743af98d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:49.861498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:49.863362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-215033ba-f2ba-4bdd-b025-c3743af98d78 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:49.865045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-215033ba-f2ba-4bdd-b025-c3743af98d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:49.881257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de1521-5597-4a42-a6eb-622d292d0c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:49.881920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1521-5597-4a42-a6eb-622d292d0c9e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:49.882201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1521-5597-4a42-a6eb-622d292d0c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:49.882473 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1521-5597-4a42-a6eb-622d292d0c9e None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:49.883193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de1521-5597-4a42-a6eb-622d292d0c9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:49.883496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de1521-5597-4a42-a6eb-622d292d0c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:49.884889 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de1521-5597-4a42-a6eb-622d292d0c9e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:49.897921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 531/1065] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:49.942987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 535/1066] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:49.967267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de1521-5597-4a42-a6eb-622d292d0c9e None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:50.075175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de1521-5597-4a42-a6eb-622d292d0c9e None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:50.112489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa358b-de9f-4a2a-b10e-e3518792192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:50.113311 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa358b-de9f-4a2a-b10e-e3518792192a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:50.113593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa358b-de9f-4a2a-b10e-e3518792192a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:50.113904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa358b-de9f-4a2a-b10e-e3518792192a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:50.126021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa358b-de9f-4a2a-b10e-e3518792192a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-adfa358b-de9f-4a2a-b10e-e3518792192a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:50.134896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:50.136052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:50.137137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 532/1067] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 20 05:55:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:50.143523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215033ba-f2ba-4bdd-b025-c3743af98d78 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:50.153217 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:50.252581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215033ba-f2ba-4bdd-b025-c3743af98d78 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:50.285774 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7b686-d807-4b32-bc00-cc52a065af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:50.286421 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b686-d807-4b32-bc00-cc52a065af7b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:50.286705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b686-d807-4b32-bc00-cc52a065af7b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:50.286979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7b686-d807-4b32-bc00-cc52a065af7b None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:50.287725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7b686-d807-4b32-bc00-cc52a065af7b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:50.288032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7b686-d807-4b32-bc00-cc52a065af7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:50.289427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7b686-d807-4b32-bc00-cc52a065af7b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:50.297121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 536/1068] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 20 05:55:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:50.303175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa358b-de9f-4a2a-b10e-e3518792192a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:50.341958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:50.403549 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa358b-de9f-4a2a-b10e-e3518792192a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:50.436504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00601455-86a3-44bc-8640-afbe958a30c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:50.437300 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00601455-86a3-44bc-8640-afbe958a30c3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:50.437586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00601455-86a3-44bc-8640-afbe958a30c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:50.437861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00601455-86a3-44bc-8640-afbe958a30c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:50.448909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00601455-86a3-44bc-8640-afbe958a30c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:50.450355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00601455-86a3-44bc-8640-afbe958a30c3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-00601455-86a3-44bc-8640-afbe958a30c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:50.467058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:50.467930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:50.469095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:50.469095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:50.469095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:50.469095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:50.469095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 533/1069] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:50.473924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7b686-d807-4b32-bc00-cc52a065af7b None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:50.540292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:50.573866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7b686-d807-4b32-bc00-cc52a065af7b None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:50.605063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9773da-707d-476b-8415-35d1ade39e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:50.605714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9773da-707d-476b-8415-35d1ade39e3c None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:50.605999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9773da-707d-476b-8415-35d1ade39e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:50.606277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9773da-707d-476b-8415-35d1ade39e3c None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:50.607001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9773da-707d-476b-8415-35d1ade39e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:50.607309 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9773da-707d-476b-8415-35d1ade39e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:50.608697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9773da-707d-476b-8415-35d1ade39e3c None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:50.620410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 537/1070] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:50.626014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00601455-86a3-44bc-8640-afbe958a30c3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:50.713000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:50.722757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00601455-86a3-44bc-8640-afbe958a30c3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:50.755580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac6ec8-3ee2-4ab2-b821-368ae3f674e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:50.756391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac6ec8-3ee2-4ab2-b821-368ae3f674e1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:50.756674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac6ec8-3ee2-4ab2-b821-368ae3f674e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:50.756945 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac6ec8-3ee2-4ab2-b821-368ae3f674e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:50.764178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac6ec8-3ee2-4ab2-b821-368ae3f674e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:50.765642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac6ec8-3ee2-4ab2-b821-368ae3f674e1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c0ac6ec8-3ee2-4ab2-b821-368ae3f674e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:50.779415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:50.780456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:50.781426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:50.781426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:50.781426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:50.781426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:50.781426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:50.781426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:50.781426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:50.781426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:50.781426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:50.781426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:50.781426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 534/1071] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 20 05:55:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:50.786758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9773da-707d-476b-8415-35d1ade39e3c None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:50.884821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9773da-707d-476b-8415-35d1ade39e3c None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:50.910123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:50.918545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4982b-4d6f-4c9c-a9d0-420f4accfaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:50.919209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4982b-4d6f-4c9c-a9d0-420f4accfaac None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:50.919492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4982b-4d6f-4c9c-a9d0-420f4accfaac None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:50.919767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4982b-4d6f-4c9c-a9d0-420f4accfaac None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:50.920632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4982b-4d6f-4c9c-a9d0-420f4accfaac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:50.920943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4982b-4d6f-4c9c-a9d0-420f4accfaac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:50.922362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4982b-4d6f-4c9c-a9d0-420f4accfaac None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:50.939402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 538/1072] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 20 05:55:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:50.944839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac6ec8-3ee2-4ab2-b821-368ae3f674e1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:51.042218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac6ec8-3ee2-4ab2-b821-368ae3f674e1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:51.074952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954a7b-c4a7-42dd-a865-dc315574bb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:51.075726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954a7b-c4a7-42dd-a865-dc315574bb7b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:51.076007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954a7b-c4a7-42dd-a865-dc315574bb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:51.076282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954a7b-c4a7-42dd-a865-dc315574bb7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:51.086403 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6954a7b-c4a7-42dd-a865-dc315574bb7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:51.087836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6954a7b-c4a7-42dd-a865-dc315574bb7b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a6954a7b-c4a7-42dd-a865-dc315574bb7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:51.104217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:51.105310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:51.106265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:51.106265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:51.106265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:51.106265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:51.106265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 535/1073] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:51.110920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4982b-4d6f-4c9c-a9d0-420f4accfaac None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:51.206493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4982b-4d6f-4c9c-a9d0-420f4accfaac None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:51.240776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb38f9c-952e-46a0-be70-32380a9f367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:51.241449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb38f9c-952e-46a0-be70-32380a9f367e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:51.241790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb38f9c-952e-46a0-be70-32380a9f367e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:51.242011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb38f9c-952e-46a0-be70-32380a9f367e None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:51.242738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb38f9c-952e-46a0-be70-32380a9f367e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:51.243047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb38f9c-952e-46a0-be70-32380a9f367e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:51.244425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb38f9c-952e-46a0-be70-32380a9f367e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:51.256195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 539/1074] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:51.261727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954a7b-c4a7-42dd-a865-dc315574bb7b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:51.264635 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:51.358193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954a7b-c4a7-42dd-a865-dc315574bb7b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:51.390367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d4f68-1b0c-4729-a7f7-ee384a0d43c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:51.391151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4f68-1b0c-4729-a7f7-ee384a0d43c3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:51.391434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4f68-1b0c-4729-a7f7-ee384a0d43c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:51.391709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4f68-1b0c-4729-a7f7-ee384a0d43c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:51.398223 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d4f68-1b0c-4729-a7f7-ee384a0d43c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:51.399654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d4f68-1b0c-4729-a7f7-ee384a0d43c3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-832d4f68-1b0c-4729-a7f7-ee384a0d43c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:51.414234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:51.415286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:51.416193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:51.416193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:51.416193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:51.416193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:51.416193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:51.416193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:51.416193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:51.416193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:51.416193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 536/1075] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:51.421208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb38f9c-952e-46a0-be70-32380a9f367e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:51.465994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:51.517793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb38f9c-952e-46a0-be70-32380a9f367e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:51.549871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a61d4-4983-48b2-949a-36db82028118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:51.550513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a61d4-4983-48b2-949a-36db82028118 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:51.550795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a61d4-4983-48b2-949a-36db82028118 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:51.551070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a61d4-4983-48b2-949a-36db82028118 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:51.552453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a61d4-4983-48b2-949a-36db82028118 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:51.552766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a61d4-4983-48b2-949a-36db82028118 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:51.554182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a61d4-4983-48b2-949a-36db82028118 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:51.565666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 540/1076] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:51.571529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d4f68-1b0c-4729-a7f7-ee384a0d43c3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:51.631184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:51.668921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d4f68-1b0c-4729-a7f7-ee384a0d43c3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:51.701548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ad0d6-fb62-458b-8a1b-e5cf9b49a901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:51.702430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ad0d6-fb62-458b-8a1b-e5cf9b49a901 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:51.702713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ad0d6-fb62-458b-8a1b-e5cf9b49a901 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:51.702988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ad0d6-fb62-458b-8a1b-e5cf9b49a901 None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/cbe8aea409c3459f9f7b3c3ef6ff583b/roles/74cbcc96b8814e84a977b222c3575a05` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:51.705203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ad0d6-fb62-458b-8a1b-e5cf9b49a901 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=cbe8aea409c3459f9f7b3c3ef6ff583b, role_id=74cbcc96b8814e84a977b222c3575a05)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:51.706639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ad0d6-fb62-458b-8a1b-e5cf9b49a901 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:51.719316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 537/1077] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:55:51 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/cbe8aea409c3459f9f7b3c3ef6ff583b/roles/74cbcc96b8814e84a977b222c3575a05 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:55:51.737610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b57c8f-f95f-4b30-9a92-0e0a99e8d29f None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:51.737899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b57c8f-f95f-4b30-9a92-0e0a99e8d29f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:51.738176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b57c8f-f95f-4b30-9a92-0e0a99e8d29f None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:51.740206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 541/1078] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:51.746878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7784-cf3f-48a2-b0f1-3234bc945480 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:51.747165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7784-cf3f-48a2-b0f1-3234bc945480 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:51.747473 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7784-cf3f-48a2-b0f1-3234bc945480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:51.765161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-bd9f7784-cf3f-48a2-b0f1-3234bc945480 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:51.766402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bd9f7784-cf3f-48a2-b0f1-3234bc945480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:51.837601 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 538/1079] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:51.863658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b57c8f-f95f-4b30-9a92-0e0a99e8d29f None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:51.963499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b57c8f-f95f-4b30-9a92-0e0a99e8d29f None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:51.971832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:51.998632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a958e9-618f-46f8-84c4-35fbc0fe0211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:51.999410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a958e9-618f-46f8-84c4-35fbc0fe0211 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:51.999689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a958e9-618f-46f8-84c4-35fbc0fe0211 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:51.999956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a958e9-618f-46f8-84c4-35fbc0fe0211 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:52.009703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a958e9-618f-46f8-84c4-35fbc0fe0211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-10a958e9-618f-46f8-84c4-35fbc0fe0211 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:52.017141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:52.018350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:52.019259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 542/1080] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:52.024968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f7784-cf3f-48a2-b0f1-3234bc945480 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:52.075632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:52.121790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f7784-cf3f-48a2-b0f1-3234bc945480 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:52.155177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519dd9e-b8cd-44fe-8765-6b1930a2c7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:52.155841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519dd9e-b8cd-44fe-8765-6b1930a2c7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:52.156125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519dd9e-b8cd-44fe-8765-6b1930a2c7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:52.156436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519dd9e-b8cd-44fe-8765-6b1930a2c7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:52.157179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519dd9e-b8cd-44fe-8765-6b1930a2c7b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:52.157489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519dd9e-b8cd-44fe-8765-6b1930a2c7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:52.158853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519dd9e-b8cd-44fe-8765-6b1930a2c7b9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:52.166883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 539/1081] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:55:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:52.172592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a958e9-618f-46f8-84c4-35fbc0fe0211 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:52.274133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a958e9-618f-46f8-84c4-35fbc0fe0211 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:52.305835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7bdcb-2132-44ed-bec4-c87df97f188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:52.306689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7bdcb-2132-44ed-bec4-c87df97f188e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:52.306974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7bdcb-2132-44ed-bec4-c87df97f188e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:52.307251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7bdcb-2132-44ed-bec4-c87df97f188e None admin] PATH_INFO: `/v3/users/c94a11b08e8f458c9b326b707dd6a6a6` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:52.308469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7bdcb-2132-44ed-bec4-c87df97f188e None admin] RBAC: Authorizing `identity:get_user(user_id=c94a11b08e8f458c9b326b707dd6a6a6)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:52.309904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7bdcb-2132-44ed-bec4-c87df97f188e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:52.311523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 543/1082] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:55:52 2022] GET /identity/v3/users/c94a11b08e8f458c9b326b707dd6a6a6 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:52.317707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519dd9e-b8cd-44fe-8765-6b1930a2c7b9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:52.416766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519dd9e-b8cd-44fe-8765-6b1930a2c7b9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:52.429916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:52.450130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c40701-aefc-4165-950f-1134575a5eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:52.450988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c40701-aefc-4165-950f-1134575a5eef None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:52.451273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c40701-aefc-4165-950f-1134575a5eef None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:52.451550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c40701-aefc-4165-950f-1134575a5eef None admin] PATH_INFO: `/v3/projects/c40348c0a6a84c648288217ca61b121d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:52.452755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c40701-aefc-4165-950f-1134575a5eef None admin] RBAC: Authorizing `identity:get_project(project_id=c40348c0a6a84c648288217ca61b121d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:52.454182 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c40701-aefc-4165-950f-1134575a5eef None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:52.456032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 540/1083] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:55:52 2022] GET /identity/v3/projects/c40348c0a6a84c648288217ca61b121d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:52.462334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7bdcb-2132-44ed-bec4-c87df97f188e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:52.495723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:52.559835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7bdcb-2132-44ed-bec4-c87df97f188e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:52.592297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f4972-b371-4eb2-9b8d-09e94a680ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:52.593192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f4972-b371-4eb2-9b8d-09e94a680ee3 None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:52.593481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f4972-b371-4eb2-9b8d-09e94a680ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:52.593755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f4972-b371-4eb2-9b8d-09e94a680ee3 None admin] PATH_INFO: `/v3/projects/c40348c0a6a84c648288217ca61b121d/users/c94a11b08e8f458c9b326b707dd6a6a6/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:52.595700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f4972-b371-4eb2-9b8d-09e94a680ee3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c40348c0a6a84c648288217ca61b121d, user_id=c94a11b08e8f458c9b326b707dd6a6a6, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:52.597157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f4972-b371-4eb2-9b8d-09e94a680ee3 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:52.610964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 544/1084] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:55:52 2022] PUT /identity/v3/projects/c40348c0a6a84c648288217ca61b121d/users/c94a11b08e8f458c9b326b707dd6a6a6/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:55:53.744392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82696a8-f07d-4d27-bb55-835b9cd32ad9 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:53.744961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82696a8-f07d-4d27-bb55-835b9cd32ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:53.744961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82696a8-f07d-4d27-bb55-835b9cd32ad9 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:53.746323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 541/1085] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:53.751856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b3ca-83ae-40f4-86ae-8c0b86e466e7 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:53.752285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b3ca-83ae-40f4-86ae-8c0b86e466e7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:53.752499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b3ca-83ae-40f4-86ae-8c0b86e466e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:53.769500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-0b26b3ca-83ae-40f4-86ae-8c0b86e466e7 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:53.771242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0b26b3ca-83ae-40f4-86ae-8c0b86e466e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:53.835456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 545/1086] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:53.858807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82696a8-f07d-4d27-bb55-835b9cd32ad9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:53.958357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82696a8-f07d-4d27-bb55-835b9cd32ad9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:53.991592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe0098-f7e1-4723-aaf5-c03a10071097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:53.992420 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe0098-f7e1-4723-aaf5-c03a10071097 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:53.992708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe0098-f7e1-4723-aaf5-c03a10071097 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:53.992983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe0098-f7e1-4723-aaf5-c03a10071097 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:54.003418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe0098-f7e1-4723-aaf5-c03a10071097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-51fe0098-f7e1-4723-aaf5-c03a10071097 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:54.012161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:54.013135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:54.013965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 542/1087] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jun 20 05:55:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:55:54.019316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26b3ca-83ae-40f4-86ae-8c0b86e466e7 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:54.043126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:54.115417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26b3ca-83ae-40f4-86ae-8c0b86e466e7 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:54.147746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad3fa8-5e5d-4552-a6e4-b645a7ad8042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:54.148423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad3fa8-5e5d-4552-a6e4-b645a7ad8042 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:54.148703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad3fa8-5e5d-4552-a6e4-b645a7ad8042 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:54.148972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad3fa8-5e5d-4552-a6e4-b645a7ad8042 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:54.149709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad3fa8-5e5d-4552-a6e4-b645a7ad8042 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:54.150013 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad3fa8-5e5d-4552-a6e4-b645a7ad8042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:54.151622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad3fa8-5e5d-4552-a6e4-b645a7ad8042 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:54.159317 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 546/1088] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 20 05:55:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:54.164909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe0098-f7e1-4723-aaf5-c03a10071097 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:54.206649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:54.266010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe0098-f7e1-4723-aaf5-c03a10071097 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:54.298812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4dca2-808e-47cd-a3b5-12e6464111eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:54.299608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4dca2-808e-47cd-a3b5-12e6464111eb None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:54.299894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4dca2-808e-47cd-a3b5-12e6464111eb None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:54.300169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4dca2-808e-47cd-a3b5-12e6464111eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:54.310574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4dca2-808e-47cd-a3b5-12e6464111eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:54.312023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4dca2-808e-47cd-a3b5-12e6464111eb None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-7df4dca2-808e-47cd-a3b5-12e6464111eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:54.329631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:54.330665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:54.331604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:54.331604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:54.331604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:54.331604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:54.331604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 543/1089] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:54.336622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad3fa8-5e5d-4552-a6e4-b645a7ad8042 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:54.419045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:54.434434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad3fa8-5e5d-4552-a6e4-b645a7ad8042 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:54.466510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8ef38-f1e6-4e91-ab7e-83980fdf7068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:54.467196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ef38-f1e6-4e91-ab7e-83980fdf7068 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:54.467484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ef38-f1e6-4e91-ab7e-83980fdf7068 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:54.467763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ef38-f1e6-4e91-ab7e-83980fdf7068 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:54.468516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8ef38-f1e6-4e91-ab7e-83980fdf7068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:54.468830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8ef38-f1e6-4e91-ab7e-83980fdf7068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:54.470188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8ef38-f1e6-4e91-ab7e-83980fdf7068 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:54.482095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 547/1090] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:54.487631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4dca2-808e-47cd-a3b5-12e6464111eb None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:54.578433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:54.585179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4dca2-808e-47cd-a3b5-12e6464111eb None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:54.595378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10371c-297c-4d32-9c1b-85a7a3db8732 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:54.595671 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10371c-297c-4d32-9c1b-85a7a3db8732 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:54.595956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10371c-297c-4d32-9c1b-85a7a3db8732 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:54.597358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 548/1091] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:54.602609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13886-0fdd-48fc-a2a6-0945a64b0327 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:54.602899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13886-0fdd-48fc-a2a6-0945a64b0327 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:54.603180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13886-0fdd-48fc-a2a6-0945a64b0327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:54.619268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efc26e-ca87-4ddb-9518-dd984daca307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:54.620049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efc26e-ca87-4ddb-9518-dd984daca307 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:54.620350 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efc26e-ca87-4ddb-9518-dd984daca307 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:54.620627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efc26e-ca87-4ddb-9518-dd984daca307 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:54.620796 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8fd13886-0fdd-48fc-a2a6-0945a64b0327 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:54.621985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8fd13886-0fdd-48fc-a2a6-0945a64b0327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:54.627590 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efc26e-ca87-4ddb-9518-dd984daca307 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:54.629056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efc26e-ca87-4ddb-9518-dd984daca307 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-c9efc26e-ca87-4ddb-9518-dd984daca307 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:55:54.643095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:54.644052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:54.645232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:54.645232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:54.645232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:55:54.645232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:55:54.645232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:55:54.645232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:55:54.645232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:55:54.645232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:55:54.645232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 05:55:54.645232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:54.645232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 544/1092] 10.222.0.13 () {56 vars in 1093 bytes} [Mon Jun 20 05:55:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:54.649846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efc26e-ca87-4ddb-9518-dd984daca307 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:54.693635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 549/1093] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:55:54.716710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13886-0fdd-48fc-a2a6-0945a64b0327 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:54.746440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efc26e-ca87-4ddb-9518-dd984daca307 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:54.780790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a57e2-f6b9-4fcd-a533-6329b88b3295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:54.781452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a57e2-f6b9-4fcd-a533-6329b88b3295 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:54.781728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a57e2-f6b9-4fcd-a533-6329b88b3295 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:54.781998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a57e2-f6b9-4fcd-a533-6329b88b3295 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:54.782827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a57e2-f6b9-4fcd-a533-6329b88b3295 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:54.783133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a57e2-f6b9-4fcd-a533-6329b88b3295 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:54.784583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a57e2-f6b9-4fcd-a533-6329b88b3295 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:54.790745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:54.803251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 545/1094] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jun 20 05:55:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:54.808804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a57e2-f6b9-4fcd-a533-6329b88b3295 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:54.813156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13886-0fdd-48fc-a2a6-0945a64b0327 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:54.822401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:54.846448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609ff94-cabd-48cc-a47e-0b220290fadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:54.847166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609ff94-cabd-48cc-a47e-0b220290fadb None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:54.847448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609ff94-cabd-48cc-a47e-0b220290fadb None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:54.847724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609ff94-cabd-48cc-a47e-0b220290fadb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:54.858030 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609ff94-cabd-48cc-a47e-0b220290fadb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-c609ff94-cabd-48cc-a47e-0b220290fadb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:55:54.865611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:54.866628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:55:54.867529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 550/1095] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:55:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:54.872645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609ff94-cabd-48cc-a47e-0b220290fadb None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:54.907787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a57e2-f6b9-4fcd-a533-6329b88b3295 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:54.941783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac161601-ab3e-4c8a-b7da-d3fab861b103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:54.942425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac161601-ab3e-4c8a-b7da-d3fab861b103 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:54.942708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac161601-ab3e-4c8a-b7da-d3fab861b103 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:54.942985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac161601-ab3e-4c8a-b7da-d3fab861b103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:54.971420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609ff94-cabd-48cc-a47e-0b220290fadb None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:55.005312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcb395-311a-4e45-93c8-957ff6cd7723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:55.005961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb395-311a-4e45-93c8-957ff6cd7723 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:55.006244 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb395-311a-4e45-93c8-957ff6cd7723 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:55.006520 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb395-311a-4e45-93c8-957ff6cd7723 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:55.007263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcb395-311a-4e45-93c8-957ff6cd7723 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:55.007570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcb395-311a-4e45-93c8-957ff6cd7723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:55.008955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcb395-311a-4e45-93c8-957ff6cd7723 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:55.009972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac161601-ab3e-4c8a-b7da-d3fab861b103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:55.011171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:55.011401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac161601-ab3e-4c8a-b7da-d3fab861b103 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:55.017737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 551/1096] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:55:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:55.023815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcb395-311a-4e45-93c8-957ff6cd7723 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:55.026291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:55.114725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 546/1097] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:55:55.119601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcb395-311a-4e45-93c8-957ff6cd7723 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:55.120669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac161601-ab3e-4c8a-b7da-d3fab861b103 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:55.153238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c001f-52ba-49c1-9169-2919e344a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:55.154114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c001f-52ba-49c1-9169-2919e344a3fd None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:55.154399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c001f-52ba-49c1-9169-2919e344a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:55.154671 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c001f-52ba-49c1-9169-2919e344a3fd None admin] PATH_INFO: `/v3/users/c94a11b08e8f458c9b326b707dd6a6a6` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:55.155876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c001f-52ba-49c1-9169-2919e344a3fd None admin] RBAC: Authorizing `identity:get_user(user_id=c94a11b08e8f458c9b326b707dd6a6a6)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:55.157325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c001f-52ba-49c1-9169-2919e344a3fd None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:55.158946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 552/1098] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:55:55 2022] GET /identity/v3/users/c94a11b08e8f458c9b326b707dd6a6a6 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:55.164383 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c001f-52ba-49c1-9169-2919e344a3fd None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:55.217588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac161601-ab3e-4c8a-b7da-d3fab861b103 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:55.226655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:55.231197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:55.256880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf96d5b-331d-4a01-9250-90415789d80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:55.257670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf96d5b-331d-4a01-9250-90415789d80b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:55.257953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf96d5b-331d-4a01-9250-90415789d80b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:55.258230 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf96d5b-331d-4a01-9250-90415789d80b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:55.263702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c001f-52ba-49c1-9169-2919e344a3fd None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:55.268161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf96d5b-331d-4a01-9250-90415789d80b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:55.269634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf96d5b-331d-4a01-9250-90415789d80b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-dbf96d5b-331d-4a01-9250-90415789d80b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:55:55.287669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:55.288910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:55.289828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:55:55.289828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:55:55.289828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:55:55.289828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:55.289828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 547/1099] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:55.294473 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf96d5b-331d-4a01-9250-90415789d80b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:55.298761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f9882-0328-4cde-a989-b4fed68d1781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:55.299409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f9882-0328-4cde-a989-b4fed68d1781 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:55.299687 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f9882-0328-4cde-a989-b4fed68d1781 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:55.299963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f9882-0328-4cde-a989-b4fed68d1781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:55.365196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f9882-0328-4cde-a989-b4fed68d1781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:55.366604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f9882-0328-4cde-a989-b4fed68d1781 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:55.390503 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf96d5b-331d-4a01-9250-90415789d80b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:55.425246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca614e-4f9d-4e82-8ccf-e14e638e49f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:55.425892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca614e-4f9d-4e82-8ccf-e14e638e49f1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:55.426177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca614e-4f9d-4e82-8ccf-e14e638e49f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:55.426453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca614e-4f9d-4e82-8ccf-e14e638e49f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:55.427170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca614e-4f9d-4e82-8ccf-e14e638e49f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:55.427475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca614e-4f9d-4e82-8ccf-e14e638e49f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:55.428870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca614e-4f9d-4e82-8ccf-e14e638e49f1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:55.429909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:55.440798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 548/1100] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:55.446845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca614e-4f9d-4e82-8ccf-e14e638e49f1 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:55.468529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 553/1101] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:55:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:55:55.471736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:55.474097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f9882-0328-4cde-a989-b4fed68d1781 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:55.545033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca614e-4f9d-4e82-8ccf-e14e638e49f1 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:55.572722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f9882-0328-4cde-a989-b4fed68d1781 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:55.578294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72b5e8-9f6c-44ab-9fba-fc48a6019dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:55.579074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72b5e8-9f6c-44ab-9fba-fc48a6019dca None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:55.579356 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72b5e8-9f6c-44ab-9fba-fc48a6019dca None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:55.579632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72b5e8-9f6c-44ab-9fba-fc48a6019dca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:55.586137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72b5e8-9f6c-44ab-9fba-fc48a6019dca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:55.587582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72b5e8-9f6c-44ab-9fba-fc48a6019dca None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-bd72b5e8-9f6c-44ab-9fba-fc48a6019dca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:55:55.601468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:55:55.602556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:55:55.603570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:55:55.603570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:55:55.603570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:55:55.603570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:55:55.603570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:55:55.603570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:55:55.603570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:55:55.603570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:55:55.603570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 549/1102] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:55:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:55:55.608397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72b5e8-9f6c-44ab-9fba-fc48a6019dca None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:55.610921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb534115-590a-4b2f-95e2-41d8db9fcae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:55.612433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb534115-590a-4b2f-95e2-41d8db9fcae6 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:55.612892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb534115-590a-4b2f-95e2-41d8db9fcae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:55.613182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb534115-590a-4b2f-95e2-41d8db9fcae6 None admin] PATH_INFO: `/v3/projects/c40348c0a6a84c648288217ca61b121d` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:55.615022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb534115-590a-4b2f-95e2-41d8db9fcae6 None admin] RBAC: Authorizing `identity:get_project(project_id=c40348c0a6a84c648288217ca61b121d)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:55.616546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb534115-590a-4b2f-95e2-41d8db9fcae6 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:55.618205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 554/1103] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:55:55 2022] GET /identity/v3/projects/c40348c0a6a84c648288217ca61b121d => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:55.624182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb534115-590a-4b2f-95e2-41d8db9fcae6 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:55.658858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:55.694785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:55.710775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72b5e8-9f6c-44ab-9fba-fc48a6019dca None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:55.728018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb534115-590a-4b2f-95e2-41d8db9fcae6 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:55.743441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38198e70-23b5-4b7f-9f74-ae42aa187937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:55.744093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198e70-23b5-4b7f-9f74-ae42aa187937 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:55.744410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198e70-23b5-4b7f-9f74-ae42aa187937 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:55.744682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38198e70-23b5-4b7f-9f74-ae42aa187937 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:55.745464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38198e70-23b5-4b7f-9f74-ae42aa187937 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:55.745773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38198e70-23b5-4b7f-9f74-ae42aa187937 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:55.747233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38198e70-23b5-4b7f-9f74-ae42aa187937 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:55.765275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 550/1104] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:55:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:55.765447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc69738-ebf8-4bd9-bb24-a97596ee3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:55.765447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69738-ebf8-4bd9-bb24-a97596ee3767 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:55.765447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69738-ebf8-4bd9-bb24-a97596ee3767 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:55.765447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc69738-ebf8-4bd9-bb24-a97596ee3767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:55.766280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38198e70-23b5-4b7f-9f74-ae42aa187937 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:55.767019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc69738-ebf8-4bd9-bb24-a97596ee3767 None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=c40348c0a6a84c648288217ca61b121d, user.id=c94a11b08e8f458c9b326b707dd6a6a6) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:55.767346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc69738-ebf8-4bd9-bb24-a97596ee3767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:55.768838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc69738-ebf8-4bd9-bb24-a97596ee3767 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:55.775337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 555/1105] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:55 2022] GET /identity/v3/role_assignments?user.id=c94a11b08e8f458c9b326b707dd6a6a6&scope.project.id=c40348c0a6a84c648288217ca61b121d&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:55.871135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38198e70-23b5-4b7f-9f74-ae42aa187937 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:55.906013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126528d-6242-4e4c-a7fb-3adb18cced93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:55.906680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126528d-6242-4e4c-a7fb-3adb18cced93 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:55.906965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126528d-6242-4e4c-a7fb-3adb18cced93 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:55.907243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126528d-6242-4e4c-a7fb-3adb18cced93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:55.908080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126528d-6242-4e4c-a7fb-3adb18cced93 None admin] RBAC: Adding query filter params (role.id=74cbcc96b8814e84a977b222c3575a05, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=cbe8aea409c3459f9f7b3c3ef6ff583b) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:55:55.908427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126528d-6242-4e4c-a7fb-3adb18cced93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:55.909873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126528d-6242-4e4c-a7fb-3adb18cced93 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:55.916770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 551/1106] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:55:55 2022] GET /identity/v3/role_assignments?user.id=cbe8aea409c3459f9f7b3c3ef6ff583b&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=74cbcc96b8814e84a977b222c3575a05 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:55:57.821337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61874e66-7af2-45f1-ad4c-391e610277f1 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:57.821870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61874e66-7af2-45f1-ad4c-391e610277f1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:57.821870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61874e66-7af2-45f1-ad4c-391e610277f1 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:57.823260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 556/1107] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:55:57.828610 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023df9-4836-4b7a-9558-fc4345c0cc8a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:57.829016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023df9-4836-4b7a-9558-fc4345c0cc8a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:57.829168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023df9-4836-4b7a-9558-fc4345c0cc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:57.846052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-00023df9-4836-4b7a-9558-fc4345c0cc8a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:55:57.847235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-00023df9-4836-4b7a-9558-fc4345c0cc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:55:57.849715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:57.912965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 552/1108] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:55:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:55:57.937623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61874e66-7af2-45f1-ad4c-391e610277f1 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:58.031021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:58.036636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61874e66-7af2-45f1-ad4c-391e610277f1 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:58.068196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461506db-a11f-4924-8c34-d483217554e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:58.069000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461506db-a11f-4924-8c34-d483217554e4 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:58.069282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461506db-a11f-4924-8c34-d483217554e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:58.069558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461506db-a11f-4924-8c34-d483217554e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:58.070717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461506db-a11f-4924-8c34-d483217554e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:58.072191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461506db-a11f-4924-8c34-d483217554e4 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:58.073777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 557/1109] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:55:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:55:58.079392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00023df9-4836-4b7a-9558-fc4345c0cc8a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:55:58.174644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00023df9-4836-4b7a-9558-fc4345c0cc8a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:55:58.207110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbb94c-1e8c-450c-9779-f0fc5444d4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:55:58.208297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb94c-1e8c-450c-9779-f0fc5444d4d0 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:55:58.208606 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb94c-1e8c-450c-9779-f0fc5444d4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:55:58.208882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb94c-1e8c-450c-9779-f0fc5444d4d0 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:55:58.209585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbb94c-1e8c-450c-9779-f0fc5444d4d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:55:58.211006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbb94c-1e8c-450c-9779-f0fc5444d4d0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:55:58.221864 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:55:58.237611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 553/1110] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:55:58 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:56:00.268451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34ff58-5737-4794-929b-212192c3fc43 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:00.268956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34ff58-5737-4794-929b-212192c3fc43 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:00.269059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34ff58-5737-4794-929b-212192c3fc43 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:00.270897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 558/1111] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:00.276259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d78175-6987-49c2-97ef-164c07a0ef30 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:00.276687 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d78175-6987-49c2-97ef-164c07a0ef30 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:00.276834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d78175-6987-49c2-97ef-164c07a0ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:00.293753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-57d78175-6987-49c2-97ef-164c07a0ef30 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:00.294920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-57d78175-6987-49c2-97ef-164c07a0ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:00.357778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 554/1112] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:00.381457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34ff58-5737-4794-929b-212192c3fc43 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:00.479638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34ff58-5737-4794-929b-212192c3fc43 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:00.512085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ca01d-b058-42a3-b4d9-2d608ad6ac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:00.512897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ca01d-b058-42a3-b4d9-2d608ad6ac87 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:00.513185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ca01d-b058-42a3-b4d9-2d608ad6ac87 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:00.513463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ca01d-b058-42a3-b4d9-2d608ad6ac87 None admin] PATH_INFO: `/v3/roles/5cdb558ab7044154896c8f9e3dfba431` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:00.514936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ca01d-b058-42a3-b4d9-2d608ad6ac87 None admin] RBAC: Authorizing `identity:get_role(role_id=5cdb558ab7044154896c8f9e3dfba431)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:00.516296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ca01d-b058-42a3-b4d9-2d608ad6ac87 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:00.517669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 559/1113] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:00 2022] GET /identity/v3/roles/5cdb558ab7044154896c8f9e3dfba431 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:00.523777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d78175-6987-49c2-97ef-164c07a0ef30 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:00.617922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d78175-6987-49c2-97ef-164c07a0ef30 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:00.640068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:00.651948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e5f9c-c89a-45cd-8104-22ed98fa4398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:00.652825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e5f9c-c89a-45cd-8104-22ed98fa4398 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:00.653105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e5f9c-c89a-45cd-8104-22ed98fa4398 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:00.653375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e5f9c-c89a-45cd-8104-22ed98fa4398 None admin] PATH_INFO: `/v3/users/2dfa431aeb1949e29bcbfa6ad6a8c300` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:00.665909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e5f9c-c89a-45cd-8104-22ed98fa4398 None admin] RBAC: Authorizing `identity:get_user(user_id=2dfa431aeb1949e29bcbfa6ad6a8c300)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:00.667327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e5f9c-c89a-45cd-8104-22ed98fa4398 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:00.668958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 555/1114] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:00 2022] GET /identity/v3/users/2dfa431aeb1949e29bcbfa6ad6a8c300 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:00.674623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ca01d-b058-42a3-b4d9-2d608ad6ac87 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:00.708251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:00.771397 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ca01d-b058-42a3-b4d9-2d608ad6ac87 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:00.806207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d88cf-de18-4551-ae8e-f0d460792602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:00.806840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d88cf-de18-4551-ae8e-f0d460792602 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:00.807124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d88cf-de18-4551-ae8e-f0d460792602 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:00.807401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d88cf-de18-4551-ae8e-f0d460792602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:00.873948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d88cf-de18-4551-ae8e-f0d460792602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:00.875402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d88cf-de18-4551-ae8e-f0d460792602 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:00.907524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:00.974386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 560/1115] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:56:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:00.980301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e5f9c-c89a-45cd-8104-22ed98fa4398 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:01.083823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e5f9c-c89a-45cd-8104-22ed98fa4398 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:01.115770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad61034-e6c9-4a86-9ed5-dd792937c3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:01.116637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad61034-e6c9-4a86-9ed5-dd792937c3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:01.116914 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad61034-e6c9-4a86-9ed5-dd792937c3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:01.117182 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad61034-e6c9-4a86-9ed5-dd792937c3e3 None admin] PATH_INFO: `/v3/projects/c40348c0a6a84c648288217ca61b121d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:01.118330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad61034-e6c9-4a86-9ed5-dd792937c3e3 None admin] RBAC: Authorizing `identity:get_project(project_id=c40348c0a6a84c648288217ca61b121d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:01.119742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad61034-e6c9-4a86-9ed5-dd792937c3e3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:01.121438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 556/1116] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:56:00 2022] GET /identity/v3/projects/c40348c0a6a84c648288217ca61b121d => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:01.127643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d88cf-de18-4551-ae8e-f0d460792602 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:01.222607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d88cf-de18-4551-ae8e-f0d460792602 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:01.256028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966b537-4799-4524-890a-3b3da5529794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:01.256701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966b537-4799-4524-890a-3b3da5529794 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:01.256982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966b537-4799-4524-890a-3b3da5529794 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:01.257255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966b537-4799-4524-890a-3b3da5529794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:01.258074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966b537-4799-4524-890a-3b3da5529794 None admin] RBAC: Adding query filter params (role.id=5cdb558ab7044154896c8f9e3dfba431, scope.project.id=c40348c0a6a84c648288217ca61b121d, user.id=2dfa431aeb1949e29bcbfa6ad6a8c300) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:01.258386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966b537-4799-4524-890a-3b3da5529794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:01.259792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966b537-4799-4524-890a-3b3da5529794 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:01.261582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:01.265879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 561/1117] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:56:01 2022] GET /identity/v3/role_assignments?user.id=2dfa431aeb1949e29bcbfa6ad6a8c300&scope.project.id=c40348c0a6a84c648288217ca61b121d&role.id=5cdb558ab7044154896c8f9e3dfba431 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:03.237016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460e16-c3a8-4448-a17a-ff4a0c67a437 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:03.237465 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460e16-c3a8-4448-a17a-ff4a0c67a437 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:03.237566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460e16-c3a8-4448-a17a-ff4a0c67a437 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:03.239464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 557/1118] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:03.244789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95c53-bece-49a0-a621-1c6913b49d95 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:03.245296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95c53-bece-49a0-a621-1c6913b49d95 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:03.245396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e95c53-bece-49a0-a621-1c6913b49d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:03.262142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-62e95c53-bece-49a0-a621-1c6913b49d95 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:03.263316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-62e95c53-bece-49a0-a621-1c6913b49d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:03.329389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 562/1119] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:03.352325 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8460e16-c3a8-4448-a17a-ff4a0c67a437 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:03.401987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:03.450891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8460e16-c3a8-4448-a17a-ff4a0c67a437 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:03.483012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b0479-4c06-4aa6-b2ca-a4ad618a004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:03.483853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0479-4c06-4aa6-b2ca-a4ad618a004f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:03.484137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0479-4c06-4aa6-b2ca-a4ad618a004f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:03.484443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b0479-4c06-4aa6-b2ca-a4ad618a004f None admin] PATH_INFO: `/v3/roles/5cdb558ab7044154896c8f9e3dfba431` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:03.485966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b0479-4c06-4aa6-b2ca-a4ad618a004f None admin] RBAC: Authorizing `identity:get_role(role_id=5cdb558ab7044154896c8f9e3dfba431)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:03.487277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b0479-4c06-4aa6-b2ca-a4ad618a004f None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:03.489262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 558/1120] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:03 2022] GET /identity/v3/roles/5cdb558ab7044154896c8f9e3dfba431 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:03.495089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e95c53-bece-49a0-a621-1c6913b49d95 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:03.588249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e95c53-bece-49a0-a621-1c6913b49d95 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:03.613214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:03.621616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcfd28-b70a-4666-80cc-5d3e305f5d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:03.622468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcfd28-b70a-4666-80cc-5d3e305f5d57 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:03.622748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcfd28-b70a-4666-80cc-5d3e305f5d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:03.623021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcfd28-b70a-4666-80cc-5d3e305f5d57 None admin] PATH_INFO: `/v3/users/2dfa431aeb1949e29bcbfa6ad6a8c300` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:03.624189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcfd28-b70a-4666-80cc-5d3e305f5d57 None admin] RBAC: Authorizing `identity:get_user(user_id=2dfa431aeb1949e29bcbfa6ad6a8c300)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:03.625640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcfd28-b70a-4666-80cc-5d3e305f5d57 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:03.627236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 563/1121] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:03 2022] GET /identity/v3/users/2dfa431aeb1949e29bcbfa6ad6a8c300 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:03.633022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b0479-4c06-4aa6-b2ca-a4ad618a004f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:03.737434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b0479-4c06-4aa6-b2ca-a4ad618a004f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:03.757139 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:03.774347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cea9c-270d-4a2f-a145-e34d16da2c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:03.775458 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cea9c-270d-4a2f-a145-e34d16da2c7e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:03.775743 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cea9c-270d-4a2f-a145-e34d16da2c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:03.776018 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cea9c-270d-4a2f-a145-e34d16da2c7e None admin] PATH_INFO: `/v3/projects/c40348c0a6a84c648288217ca61b121d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:03.777218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cea9c-270d-4a2f-a145-e34d16da2c7e None admin] RBAC: Authorizing `identity:get_project(project_id=c40348c0a6a84c648288217ca61b121d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:03.778648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cea9c-270d-4a2f-a145-e34d16da2c7e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:03.780340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 559/1122] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:56:03 2022] GET /identity/v3/projects/c40348c0a6a84c648288217ca61b121d => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:03.786791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcfd28-b70a-4666-80cc-5d3e305f5d57 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:03.881491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcfd28-b70a-4666-80cc-5d3e305f5d57 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:03.914605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c97029-4279-4a6d-87cd-bfadce8d8a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:03.915487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97029-4279-4a6d-87cd-bfadce8d8a52 None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:03.915770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97029-4279-4a6d-87cd-bfadce8d8a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:03.916047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97029-4279-4a6d-87cd-bfadce8d8a52 None admin] PATH_INFO: `/v3/projects/c40348c0a6a84c648288217ca61b121d/users/2dfa431aeb1949e29bcbfa6ad6a8c300/roles/5cdb558ab7044154896c8f9e3dfba431` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:03.918264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c97029-4279-4a6d-87cd-bfadce8d8a52 None admin] RBAC: Authorizing `identity:create_grant(project_id=c40348c0a6a84c648288217ca61b121d, user_id=2dfa431aeb1949e29bcbfa6ad6a8c300, role_id=5cdb558ab7044154896c8f9e3dfba431)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:03.919700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c97029-4279-4a6d-87cd-bfadce8d8a52 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:03.931905 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 564/1123] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:56:03 2022] PUT /identity/v3/projects/c40348c0a6a84c648288217ca61b121d/users/2dfa431aeb1949e29bcbfa6ad6a8c300/roles/5cdb558ab7044154896c8f9e3dfba431 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 05:56:06.106541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02af5d-2d45-4a58-90e6-413b90624772 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:06.107071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02af5d-2d45-4a58-90e6-413b90624772 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:06.107071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02af5d-2d45-4a58-90e6-413b90624772 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:06.108498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 560/1124] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:06.117976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bff1a-7644-4819-b9e9-c5d174cdd34b None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:06.118646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bff1a-7644-4819-b9e9-c5d174cdd34b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:06.118646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bff1a-7644-4819-b9e9-c5d174cdd34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:06.134744 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-cd5bff1a-7644-4819-b9e9-c5d174cdd34b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:06.135937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-cd5bff1a-7644-4819-b9e9-c5d174cdd34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:06.183914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:06.200748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 565/1125] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:06.224945 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02af5d-2d45-4a58-90e6-413b90624772 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:06.323503 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02af5d-2d45-4a58-90e6-413b90624772 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:06.355480 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aecf8f-a7c8-42f6-b5eb-22c5a55dec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:06.356342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aecf8f-a7c8-42f6-b5eb-22c5a55dec03 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:06.356678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aecf8f-a7c8-42f6-b5eb-22c5a55dec03 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:06.356908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aecf8f-a7c8-42f6-b5eb-22c5a55dec03 None admin] PATH_INFO: `/v3/roles/5cdb558ab7044154896c8f9e3dfba431` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:06.358365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aecf8f-a7c8-42f6-b5eb-22c5a55dec03 None admin] RBAC: Authorizing `identity:get_role(role_id=5cdb558ab7044154896c8f9e3dfba431)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:06.359725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aecf8f-a7c8-42f6-b5eb-22c5a55dec03 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:06.361097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 561/1126] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:06 2022] GET /identity/v3/roles/5cdb558ab7044154896c8f9e3dfba431 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:06.367303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bff1a-7644-4819-b9e9-c5d174cdd34b None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:06.468613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bff1a-7644-4819-b9e9-c5d174cdd34b None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:06.501163 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a5dde-6bcd-4e45-9ba6-295a3327f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:06.502020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5dde-6bcd-4e45-9ba6-295a3327f9fa None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:06.502299 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5dde-6bcd-4e45-9ba6-295a3327f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:06.502569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a5dde-6bcd-4e45-9ba6-295a3327f9fa None admin] PATH_INFO: `/v3/users/2dfa431aeb1949e29bcbfa6ad6a8c300` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:06.503758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a5dde-6bcd-4e45-9ba6-295a3327f9fa None admin] RBAC: Authorizing `identity:get_user(user_id=2dfa431aeb1949e29bcbfa6ad6a8c300)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:06.505194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a5dde-6bcd-4e45-9ba6-295a3327f9fa None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:06.506791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 566/1127] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:06 2022] GET /identity/v3/users/2dfa431aeb1949e29bcbfa6ad6a8c300 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:06.512548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aecf8f-a7c8-42f6-b5eb-22c5a55dec03 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:06.565576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:06.607556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aecf8f-a7c8-42f6-b5eb-22c5a55dec03 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:06.640453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41843fe7-bdc2-40bb-ad85-4aefebc1fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:06.641084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41843fe7-bdc2-40bb-ad85-4aefebc1fbbc None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:06.641366 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41843fe7-bdc2-40bb-ad85-4aefebc1fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:06.641640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41843fe7-bdc2-40bb-ad85-4aefebc1fbbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:06.705488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41843fe7-bdc2-40bb-ad85-4aefebc1fbbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:06.706950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41843fe7-bdc2-40bb-ad85-4aefebc1fbbc None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:06.757943 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:06.801827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 562/1128] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:56:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:06.807584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a5dde-6bcd-4e45-9ba6-295a3327f9fa None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:06.860465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:06.902662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a5dde-6bcd-4e45-9ba6-295a3327f9fa None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:06.934700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7eff2a-2895-4656-a871-fee51b3e54dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:06.935537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eff2a-2895-4656-a871-fee51b3e54dc None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:06.935815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eff2a-2895-4656-a871-fee51b3e54dc None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:06.936086 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7eff2a-2895-4656-a871-fee51b3e54dc None admin] PATH_INFO: `/v3/projects/c40348c0a6a84c648288217ca61b121d` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:06.937276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7eff2a-2895-4656-a871-fee51b3e54dc None admin] RBAC: Authorizing `identity:get_project(project_id=c40348c0a6a84c648288217ca61b121d)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:06.938692 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7eff2a-2895-4656-a871-fee51b3e54dc None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:06.940378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 567/1129] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:56:06 2022] GET /identity/v3/projects/c40348c0a6a84c648288217ca61b121d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:06.946326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41843fe7-bdc2-40bb-ad85-4aefebc1fbbc None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:07.041151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41843fe7-bdc2-40bb-ad85-4aefebc1fbbc None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:07.072986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc153f-f24c-41eb-8b23-421942cd04ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:07.073626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc153f-f24c-41eb-8b23-421942cd04ed None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:07.073906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc153f-f24c-41eb-8b23-421942cd04ed None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:07.074181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc153f-f24c-41eb-8b23-421942cd04ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:07.074997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc153f-f24c-41eb-8b23-421942cd04ed None admin] RBAC: Adding query filter params (role.id=5cdb558ab7044154896c8f9e3dfba431, scope.project.id=c40348c0a6a84c648288217ca61b121d, user.id=2dfa431aeb1949e29bcbfa6ad6a8c300) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:07.075307 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc153f-f24c-41eb-8b23-421942cd04ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:07.076753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc153f-f24c-41eb-8b23-421942cd04ed None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:07.082942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 563/1130] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:56:06 2022] GET /identity/v3/role_assignments?user.id=2dfa431aeb1949e29bcbfa6ad6a8c300&scope.project.id=c40348c0a6a84c648288217ca61b121d&role.id=5cdb558ab7044154896c8f9e3dfba431 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:09.109150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68e692-05fb-414f-b786-6d7f1b2eefe1 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:09.109682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68e692-05fb-414f-b786-6d7f1b2eefe1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:09.109682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68e692-05fb-414f-b786-6d7f1b2eefe1 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:09.111048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 568/1131] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:09.116216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8393ee-c83a-48f7-93c3-d5a694bca5af None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:09.116659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8393ee-c83a-48f7-93c3-d5a694bca5af None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:09.116813 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8393ee-c83a-48f7-93c3-d5a694bca5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:09.133070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1a8393ee-c83a-48f7-93c3-d5a694bca5af None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:09.134246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1a8393ee-c83a-48f7-93c3-d5a694bca5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:09.147375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:09.199248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 564/1132] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:09.223733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68e692-05fb-414f-b786-6d7f1b2eefe1 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:09.320739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68e692-05fb-414f-b786-6d7f1b2eefe1 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:09.342025 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:09.353662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5de4e-6e44-4cd8-8b8c-f44c722ed7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:09.354442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5de4e-6e44-4cd8-8b8c-f44c722ed7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:09.354723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5de4e-6e44-4cd8-8b8c-f44c722ed7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:09.354995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5de4e-6e44-4cd8-8b8c-f44c722ed7c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:09.356152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5de4e-6e44-4cd8-8b8c-f44c722ed7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:09.357614 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5de4e-6e44-4cd8-8b8c-f44c722ed7c1 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:09.359258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 569/1133] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:56:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:09.365640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8393ee-c83a-48f7-93c3-d5a694bca5af None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:09.460604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8393ee-c83a-48f7-93c3-d5a694bca5af None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:09.493718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81f207-0e3b-45c7-91d0-0ff949084d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:09.494357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81f207-0e3b-45c7-91d0-0ff949084d96 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:09.494640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81f207-0e3b-45c7-91d0-0ff949084d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:09.494915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81f207-0e3b-45c7-91d0-0ff949084d96 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:09.495623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81f207-0e3b-45c7-91d0-0ff949084d96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:09.497067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81f207-0e3b-45c7-91d0-0ff949084d96 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:09.515751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:09.522734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 565/1134] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:56:09 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:56:11.572977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2080e8-de4b-462c-a97b-ff846e3daf3b None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:11.573484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2080e8-de4b-462c-a97b-ff846e3daf3b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:11.573484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2080e8-de4b-462c-a97b-ff846e3daf3b None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:11.574811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 570/1135] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:11.580052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b2149-ebd7-4667-b864-0462928b7f9d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:11.580483 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b2149-ebd7-4667-b864-0462928b7f9d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:11.580638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b2149-ebd7-4667-b864-0462928b7f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:11.596947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8f0b2149-ebd7-4667-b864-0462928b7f9d None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:11.598122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8f0b2149-ebd7-4667-b864-0462928b7f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:11.662172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 566/1136] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:11.686270 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2080e8-de4b-462c-a97b-ff846e3daf3b None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:11.783718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2080e8-de4b-462c-a97b-ff846e3daf3b None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:11.815476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399dff6f-582b-4a4f-95fd-22701c3dfab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:11.816818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dff6f-582b-4a4f-95fd-22701c3dfab5 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:11.817109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dff6f-582b-4a4f-95fd-22701c3dfab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:11.817386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dff6f-582b-4a4f-95fd-22701c3dfab5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:11.818549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399dff6f-582b-4a4f-95fd-22701c3dfab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:11.819972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399dff6f-582b-4a4f-95fd-22701c3dfab5 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:11.821581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 571/1137] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:56:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:11.827006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b2149-ebd7-4667-b864-0462928b7f9d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:11.921465 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b2149-ebd7-4667-b864-0462928b7f9d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:11.948431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:11.954489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b66c7-a664-4719-a227-06f7aa5d0e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:11.955143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b66c7-a664-4719-a227-06f7aa5d0e1b None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:11.955422 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b66c7-a664-4719-a227-06f7aa5d0e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:11.955693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b66c7-a664-4719-a227-06f7aa5d0e1b None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:11.956414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b66c7-a664-4719-a227-06f7aa5d0e1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:11.958481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b66c7-a664-4719-a227-06f7aa5d0e1b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:11.978657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 567/1138] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:56:11 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:56:14.021550 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11671-7f5b-4852-9c53-c0082a851b28 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:14.022080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11671-7f5b-4852-9c53-c0082a851b28 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:14.022080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11671-7f5b-4852-9c53-c0082a851b28 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:14.023471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 572/1139] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:14.028950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcb632-f727-436a-a3cb-34d724d6cc04 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:14.029345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcb632-f727-436a-a3cb-34d724d6cc04 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:14.029511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcb632-f727-436a-a3cb-34d724d6cc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:14.046274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-53fcb632-f727-436a-a3cb-34d724d6cc04 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:14.047451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-53fcb632-f727-436a-a3cb-34d724d6cc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:14.111591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 568/1140] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:14.135287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f11671-7f5b-4852-9c53-c0082a851b28 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:14.192841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:14.235113 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f11671-7f5b-4852-9c53-c0082a851b28 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:14.267935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429461e-d5b4-4968-b241-9541dfab0be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:14.268746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429461e-d5b4-4968-b241-9541dfab0be3 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:14.269530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429461e-d5b4-4968-b241-9541dfab0be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:14.269805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429461e-d5b4-4968-b241-9541dfab0be3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:14.279834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429461e-d5b4-4968-b241-9541dfab0be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-8429461e-d5b4-4968-b241-9541dfab0be3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:56:14.287961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:56:14.289205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:56:14.290145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 573/1141] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:56:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:56:14.295025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcb632-f727-436a-a3cb-34d724d6cc04 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:14.388937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcb632-f727-436a-a3cb-34d724d6cc04 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:14.405275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:14.424953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a95a2-5d5e-468a-ae9f-40a67d31bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:14.425642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a95a2-5d5e-468a-ae9f-40a67d31bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:14.425924 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a95a2-5d5e-468a-ae9f-40a67d31bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:14.426200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a95a2-5d5e-468a-ae9f-40a67d31bfc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:14.426942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a95a2-5d5e-468a-ae9f-40a67d31bfc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:14.427253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a95a2-5d5e-468a-ae9f-40a67d31bfc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:14.428653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a95a2-5d5e-468a-ae9f-40a67d31bfc6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:14.437573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 569/1142] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:56:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:14.443312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429461e-d5b4-4968-b241-9541dfab0be3 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:14.538453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429461e-d5b4-4968-b241-9541dfab0be3 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:14.555108 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:14.571242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb579f-ed2b-4e1b-8b96-6cb5c660ecfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:14.572092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb579f-ed2b-4e1b-8b96-6cb5c660ecfc None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:14.572400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb579f-ed2b-4e1b-8b96-6cb5c660ecfc None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:14.572674 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb579f-ed2b-4e1b-8b96-6cb5c660ecfc None admin] PATH_INFO: `/v3/users/bfad04b1f5e443099cd7930b964f998c` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:14.586719 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb579f-ed2b-4e1b-8b96-6cb5c660ecfc None admin] RBAC: Authorizing `identity:get_user(user_id=bfad04b1f5e443099cd7930b964f998c)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:14.588143 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb579f-ed2b-4e1b-8b96-6cb5c660ecfc None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:14.589783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 574/1143] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:14 2022] GET /identity/v3/users/bfad04b1f5e443099cd7930b964f998c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:14.595391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a95a2-5d5e-468a-ae9f-40a67d31bfc6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:14.689901 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a95a2-5d5e-468a-ae9f-40a67d31bfc6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:14.721374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af926aa9-c9ad-48f7-979d-a331fed80910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:14.721998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af926aa9-c9ad-48f7-979d-a331fed80910 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:14.722792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af926aa9-c9ad-48f7-979d-a331fed80910 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:14.723070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af926aa9-c9ad-48f7-979d-a331fed80910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:14.768100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:14.791275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af926aa9-c9ad-48f7-979d-a331fed80910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:14.792683 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af926aa9-c9ad-48f7-979d-a331fed80910 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:14.885958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 570/1144] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:56:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:14.891779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb579f-ed2b-4e1b-8b96-6cb5c660ecfc None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:14.988916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb579f-ed2b-4e1b-8b96-6cb5c660ecfc None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:15.020815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8869c4e-b536-4b40-b24d-f8fd42f60aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:15.021652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869c4e-b536-4b40-b24d-f8fd42f60aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:15.022192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869c4e-b536-4b40-b24d-f8fd42f60aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:15.022192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869c4e-b536-4b40-b24d-f8fd42f60aa6 None admin] PATH_INFO: `/v3/projects/06b79ca56f8540e0a4e0d13a6d85246b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:15.023334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8869c4e-b536-4b40-b24d-f8fd42f60aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=06b79ca56f8540e0a4e0d13a6d85246b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:15.025112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8869c4e-b536-4b40-b24d-f8fd42f60aa6 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:15.026853 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 575/1145] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:56:14 2022] GET /identity/v3/projects/06b79ca56f8540e0a4e0d13a6d85246b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:15.032826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af926aa9-c9ad-48f7-979d-a331fed80910 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:15.109532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:15.131202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af926aa9-c9ad-48f7-979d-a331fed80910 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:15.164006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b0fef-3713-4c94-abb8-c6d40c21ffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:15.164676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b0fef-3713-4c94-abb8-c6d40c21ffad None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:15.164959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b0fef-3713-4c94-abb8-c6d40c21ffad None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:15.165233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b0fef-3713-4c94-abb8-c6d40c21ffad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:15.166050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b0fef-3713-4c94-abb8-c6d40c21ffad None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=06b79ca56f8540e0a4e0d13a6d85246b, user.id=bfad04b1f5e443099cd7930b964f998c) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:15.166361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b0fef-3713-4c94-abb8-c6d40c21ffad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:15.167788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b0fef-3713-4c94-abb8-c6d40c21ffad None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:15.173059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 571/1146] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:56:15 2022] GET /identity/v3/role_assignments?user.id=bfad04b1f5e443099cd7930b964f998c&scope.project.id=06b79ca56f8540e0a4e0d13a6d85246b&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:17.154543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e0d33-4419-4c6b-8b7c-0e5c7a9f82fb None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:17.155092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e0d33-4419-4c6b-8b7c-0e5c7a9f82fb None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:17.155392 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e0d33-4419-4c6b-8b7c-0e5c7a9f82fb None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:17.156832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 576/1147] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:17.162480 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a13f-5af3-4b78-af05-3a4c79f7c96c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:17.162918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a13f-5af3-4b78-af05-3a4c79f7c96c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:17.163011 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9a13f-5af3-4b78-af05-3a4c79f7c96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:17.179992 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-24f9a13f-5af3-4b78-af05-3a4c79f7c96c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:17.181219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-24f9a13f-5af3-4b78-af05-3a4c79f7c96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:17.245438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 572/1148] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:17.267605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e0d33-4419-4c6b-8b7c-0e5c7a9f82fb None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:17.312847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:17.365132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e0d33-4419-4c6b-8b7c-0e5c7a9f82fb None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:17.397024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da1847-b8a3-4899-bb17-546ae6190a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:17.397788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1847-b8a3-4899-bb17-546ae6190a34 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:17.398069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1847-b8a3-4899-bb17-546ae6190a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:17.398340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da1847-b8a3-4899-bb17-546ae6190a34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:17.408266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da1847-b8a3-4899-bb17-546ae6190a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-17da1847-b8a3-4899-bb17-546ae6190a34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:56:17.416346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:56:17.417440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:56:17.418494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 577/1149] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:56:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:56:17.423664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9a13f-5af3-4b78-af05-3a4c79f7c96c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:17.489315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:17.516835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f9a13f-5af3-4b78-af05-3a4c79f7c96c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:17.549177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ad397-dee1-4b25-bb37-893e72f06f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:17.549823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ad397-dee1-4b25-bb37-893e72f06f11 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:17.550627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ad397-dee1-4b25-bb37-893e72f06f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:17.550907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ad397-dee1-4b25-bb37-893e72f06f11 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:17.551638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ad397-dee1-4b25-bb37-893e72f06f11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:17.551941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ad397-dee1-4b25-bb37-893e72f06f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:17.553406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ad397-dee1-4b25-bb37-893e72f06f11 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:17.561080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 573/1150] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:56:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:17.567326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da1847-b8a3-4899-bb17-546ae6190a34 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:17.663681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da1847-b8a3-4899-bb17-546ae6190a34 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:17.665885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:17.695992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9aebf-0c33-4fcc-bbce-b2c50062dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:17.696879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9aebf-0c33-4fcc-bbce-b2c50062dc35 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:17.697159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9aebf-0c33-4fcc-bbce-b2c50062dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:17.697431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9aebf-0c33-4fcc-bbce-b2c50062dc35 None admin] PATH_INFO: `/v3/users/bfad04b1f5e443099cd7930b964f998c` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:17.698597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9aebf-0c33-4fcc-bbce-b2c50062dc35 None admin] RBAC: Authorizing `identity:get_user(user_id=bfad04b1f5e443099cd7930b964f998c)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:17.700022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9aebf-0c33-4fcc-bbce-b2c50062dc35 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:17.701655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 578/1151] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:17 2022] GET /identity/v3/users/bfad04b1f5e443099cd7930b964f998c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:17.707359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ad397-dee1-4b25-bb37-893e72f06f11 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:17.810792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ad397-dee1-4b25-bb37-893e72f06f11 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:17.842033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c833221-b6a1-462c-85bc-09fa1de2a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:17.842882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c833221-b6a1-462c-85bc-09fa1de2a71e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:17.843160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c833221-b6a1-462c-85bc-09fa1de2a71e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:17.843428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c833221-b6a1-462c-85bc-09fa1de2a71e None admin] PATH_INFO: `/v3/projects/06b79ca56f8540e0a4e0d13a6d85246b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:17.844605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c833221-b6a1-462c-85bc-09fa1de2a71e None admin] RBAC: Authorizing `identity:get_project(project_id=06b79ca56f8540e0a4e0d13a6d85246b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:17.846027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c833221-b6a1-462c-85bc-09fa1de2a71e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:17.848208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 574/1152] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:56:17 2022] GET /identity/v3/projects/06b79ca56f8540e0a4e0d13a6d85246b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:17.854092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9aebf-0c33-4fcc-bbce-b2c50062dc35 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:17.949659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9aebf-0c33-4fcc-bbce-b2c50062dc35 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:17.981177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca50f04-10fb-4ea1-8b44-f1f26ae647df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:17.982052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50f04-10fb-4ea1-8b44-f1f26ae647df None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:17.982332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50f04-10fb-4ea1-8b44-f1f26ae647df None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:17.982602 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca50f04-10fb-4ea1-8b44-f1f26ae647df None admin] PATH_INFO: `/v3/projects/06b79ca56f8540e0a4e0d13a6d85246b/users/bfad04b1f5e443099cd7930b964f998c/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:17.984551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca50f04-10fb-4ea1-8b44-f1f26ae647df None admin] RBAC: Authorizing `identity:create_grant(project_id=06b79ca56f8540e0a4e0d13a6d85246b, user_id=bfad04b1f5e443099cd7930b964f998c, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:17.985971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca50f04-10fb-4ea1-8b44-f1f26ae647df None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:18.000116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 579/1153] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:56:17 2022] PUT /identity/v3/projects/06b79ca56f8540e0a4e0d13a6d85246b/users/bfad04b1f5e443099cd7930b964f998c/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:56:19.987197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b8e62-4f48-495a-afd6-baa1cbd314b8 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:19.988304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b8e62-4f48-495a-afd6-baa1cbd314b8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:19.988304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b8e62-4f48-495a-afd6-baa1cbd314b8 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:19.989697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 575/1154] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:19.994809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908f6ae-cb57-4020-adf5-ea24a7fcdf18 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:19.995232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908f6ae-cb57-4020-adf5-ea24a7fcdf18 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:19.995363 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908f6ae-cb57-4020-adf5-ea24a7fcdf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:20.011485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-2908f6ae-cb57-4020-adf5-ea24a7fcdf18 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:20.012687 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2908f6ae-cb57-4020-adf5-ea24a7fcdf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:20.037868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:20.078471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 580/1155] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:20.102272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b8e62-4f48-495a-afd6-baa1cbd314b8 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:20.105115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:20.202158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b8e62-4f48-495a-afd6-baa1cbd314b8 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:20.234153 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43aa96-c65c-4cae-8a7d-45cc9614cc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:20.235065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43aa96-c65c-4cae-8a7d-45cc9614cc18 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:20.235211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43aa96-c65c-4cae-8a7d-45cc9614cc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:20.235483 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43aa96-c65c-4cae-8a7d-45cc9614cc18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:20.246531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43aa96-c65c-4cae-8a7d-45cc9614cc18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-bd43aa96-c65c-4cae-8a7d-45cc9614cc18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:56:20.253947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:56:20.255019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:56:20.255928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 576/1156] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:56:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:56:20.261053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908f6ae-cb57-4020-adf5-ea24a7fcdf18 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:20.356180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908f6ae-cb57-4020-adf5-ea24a7fcdf18 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:20.388658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc96f2-1a21-4433-825f-ff0bb2f56ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:20.389306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc96f2-1a21-4433-825f-ff0bb2f56ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:20.389593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc96f2-1a21-4433-825f-ff0bb2f56ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:20.389872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc96f2-1a21-4433-825f-ff0bb2f56ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:20.390620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc96f2-1a21-4433-825f-ff0bb2f56ff9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:20.390928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc96f2-1a21-4433-825f-ff0bb2f56ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:20.392297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc96f2-1a21-4433-825f-ff0bb2f56ff9 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:20.400862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 581/1157] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:56:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:20.406535 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43aa96-c65c-4cae-8a7d-45cc9614cc18 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:20.465618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:20.502723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43aa96-c65c-4cae-8a7d-45cc9614cc18 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:20.535696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466bd19-bdd0-4cd0-9819-9c6c90e49543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:20.536576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466bd19-bdd0-4cd0-9819-9c6c90e49543 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:20.536857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466bd19-bdd0-4cd0-9819-9c6c90e49543 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:20.537125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466bd19-bdd0-4cd0-9819-9c6c90e49543 None admin] PATH_INFO: `/v3/users/bfad04b1f5e443099cd7930b964f998c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:20.538292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466bd19-bdd0-4cd0-9819-9c6c90e49543 None admin] RBAC: Authorizing `identity:get_user(user_id=bfad04b1f5e443099cd7930b964f998c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:20.539707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466bd19-bdd0-4cd0-9819-9c6c90e49543 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:20.541344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 577/1158] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:20 2022] GET /identity/v3/users/bfad04b1f5e443099cd7930b964f998c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:20.546977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc96f2-1a21-4433-825f-ff0bb2f56ff9 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:20.571402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:20.645209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc96f2-1a21-4433-825f-ff0bb2f56ff9 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:20.677232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2b4f1-4736-4302-bc5b-ae688c7eda34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:20.677867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2b4f1-4736-4302-bc5b-ae688c7eda34 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:20.678156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2b4f1-4736-4302-bc5b-ae688c7eda34 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:20.678436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2b4f1-4736-4302-bc5b-ae688c7eda34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:20.744070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2b4f1-4736-4302-bc5b-ae688c7eda34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:20.745541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2b4f1-4736-4302-bc5b-ae688c7eda34 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:20.767907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:20.839165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 582/1159] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:56:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:20.844930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466bd19-bdd0-4cd0-9819-9c6c90e49543 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:20.942179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466bd19-bdd0-4cd0-9819-9c6c90e49543 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:20.969419 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:20.975863 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c8a59-528e-401d-9444-4cba4f1f3cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:20.976753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c8a59-528e-401d-9444-4cba4f1f3cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:20.977038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c8a59-528e-401d-9444-4cba4f1f3cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:20.977316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c8a59-528e-401d-9444-4cba4f1f3cf1 None admin] PATH_INFO: `/v3/projects/06b79ca56f8540e0a4e0d13a6d85246b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:20.978486 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c8a59-528e-401d-9444-4cba4f1f3cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=06b79ca56f8540e0a4e0d13a6d85246b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:20.979907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c8a59-528e-401d-9444-4cba4f1f3cf1 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:20.981608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 578/1160] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:56:20 2022] GET /identity/v3/projects/06b79ca56f8540e0a4e0d13a6d85246b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:20.987379 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2b4f1-4736-4302-bc5b-ae688c7eda34 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:21.083057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2b4f1-4736-4302-bc5b-ae688c7eda34 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:21.105806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:21.120904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7b281-9140-4688-b0ef-924149d63f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:21.121561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7b281-9140-4688-b0ef-924149d63f35 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:21.122573 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7b281-9140-4688-b0ef-924149d63f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:21.122855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7b281-9140-4688-b0ef-924149d63f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:21.123697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7b281-9140-4688-b0ef-924149d63f35 None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=06b79ca56f8540e0a4e0d13a6d85246b, user.id=bfad04b1f5e443099cd7930b964f998c) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:21.124012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7b281-9140-4688-b0ef-924149d63f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:21.127521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7b281-9140-4688-b0ef-924149d63f35 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:21.135713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 583/1161] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:56:20 2022] GET /identity/v3/role_assignments?user.id=bfad04b1f5e443099cd7930b964f998c&scope.project.id=06b79ca56f8540e0a4e0d13a6d85246b&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:23.184294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7846c-369b-4eaf-b7da-b9fefa7e08a7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:23.184870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7846c-369b-4eaf-b7da-b9fefa7e08a7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:23.184870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7846c-369b-4eaf-b7da-b9fefa7e08a7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:23.186256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 579/1162] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:23.191929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e8cac-fe4e-44b6-bc13-6e6a81ab74ee None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:23.192375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e8cac-fe4e-44b6-bc13-6e6a81ab74ee None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:23.192505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e8cac-fe4e-44b6-bc13-6e6a81ab74ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:23.209341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4f5e8cac-fe4e-44b6-bc13-6e6a81ab74ee None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:23.210515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4f5e8cac-fe4e-44b6-bc13-6e6a81ab74ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:23.275341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 584/1163] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:23.297505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7846c-369b-4eaf-b7da-b9fefa7e08a7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:23.395279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7846c-369b-4eaf-b7da-b9fefa7e08a7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:23.428254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfbd85-f227-496a-bcf9-49586aae4fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:23.428921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfbd85-f227-496a-bcf9-49586aae4fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:23.429204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfbd85-f227-496a-bcf9-49586aae4fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:23.429480 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfbd85-f227-496a-bcf9-49586aae4fe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:23.490555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:23.494504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfbd85-f227-496a-bcf9-49586aae4fe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:23.495948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfbd85-f227-496a-bcf9-49586aae4fe4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:23.589547 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 580/1164] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:56:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:23.595419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e8cac-fe4e-44b6-bc13-6e6a81ab74ee None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:23.691074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e8cac-fe4e-44b6-bc13-6e6a81ab74ee None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:23.707340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:23.724651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd10793-3e6f-4d2e-acc4-bccde48a6827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:23.725435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd10793-3e6f-4d2e-acc4-bccde48a6827 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:23.725727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd10793-3e6f-4d2e-acc4-bccde48a6827 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:23.726003 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd10793-3e6f-4d2e-acc4-bccde48a6827 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:23.732521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd10793-3e6f-4d2e-acc4-bccde48a6827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:23.733960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd10793-3e6f-4d2e-acc4-bccde48a6827 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-2bd10793-3e6f-4d2e-acc4-bccde48a6827 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:56:23.747873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:56:23.749140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:56:23.750264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 585/1165] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 20 05:56:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:56:23.755294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfbd85-f227-496a-bcf9-49586aae4fe4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:23.851284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:23.855267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfbd85-f227-496a-bcf9-49586aae4fe4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:23.888064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49545cb9-f9f5-4c8b-b3ad-70d1db984019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:23.888738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49545cb9-f9f5-4c8b-b3ad-70d1db984019 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:23.889023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49545cb9-f9f5-4c8b-b3ad-70d1db984019 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:23.889297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49545cb9-f9f5-4c8b-b3ad-70d1db984019 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:23.890012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49545cb9-f9f5-4c8b-b3ad-70d1db984019 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:23.890318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49545cb9-f9f5-4c8b-b3ad-70d1db984019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:23.891679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49545cb9-f9f5-4c8b-b3ad-70d1db984019 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:23.899311 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 581/1166] 10.222.0.13 () {56 vars in 1115 bytes} [Mon Jun 20 05:56:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:56:25.888711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee542d-acb6-4e10-b28d-c17f8f2a9969 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:25.889237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee542d-acb6-4e10-b28d-c17f8f2a9969 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:25.889329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee542d-acb6-4e10-b28d-c17f8f2a9969 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:25.890622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 586/1167] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:25.895842 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c9c96-4464-4f3f-9a4c-dcea655f945c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:25.896259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c9c96-4464-4f3f-9a4c-dcea655f945c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:25.896433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c9c96-4464-4f3f-9a4c-dcea655f945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:25.913463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-798c9c96-4464-4f3f-9a4c-dcea655f945c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:25.914649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-798c9c96-4464-4f3f-9a4c-dcea655f945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:25.978417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 582/1168] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:26.001294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee542d-acb6-4e10-b28d-c17f8f2a9969 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:26.098665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee542d-acb6-4e10-b28d-c17f8f2a9969 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:26.137478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ad84a-54d1-4804-982f-b8f15d69e526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:26.138317 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ad84a-54d1-4804-982f-b8f15d69e526 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:26.138601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ad84a-54d1-4804-982f-b8f15d69e526 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:26.138926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ad84a-54d1-4804-982f-b8f15d69e526 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:26.139628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ad84a-54d1-4804-982f-b8f15d69e526 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:26.142133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ad84a-54d1-4804-982f-b8f15d69e526 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:26.157681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 587/1169] 10.222.0.13 () {60 vars in 1138 bytes} [Mon Jun 20 05:56:26 2022] POST /identity/v3/domains => generated 267 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:56:28.166934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581ea5a-d106-4822-a2f8-f4fe07c6cf62 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:28.167478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581ea5a-d106-4822-a2f8-f4fe07c6cf62 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:28.167478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581ea5a-d106-4822-a2f8-f4fe07c6cf62 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:28.168874 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 583/1170] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:28.173982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6dd1d-1e2d-4c7a-860d-1efc5b36016c None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:28.174392 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6dd1d-1e2d-4c7a-860d-1efc5b36016c None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:28.174535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6dd1d-1e2d-4c7a-860d-1efc5b36016c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:28.191259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-fbd6dd1d-1e2d-4c7a-860d-1efc5b36016c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:28.192456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-fbd6dd1d-1e2d-4c7a-860d-1efc5b36016c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:28.220651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:28.258478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 588/1171] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:28.282618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581ea5a-d106-4822-a2f8-f4fe07c6cf62 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:28.371855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:28.382110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581ea5a-d106-4822-a2f8-f4fe07c6cf62 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:28.415648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0ce5d-fb1f-4e60-9a40-dd3306910b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:28.416514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0ce5d-fb1f-4e60-9a40-dd3306910b30 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:28.416795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0ce5d-fb1f-4e60-9a40-dd3306910b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:28.417116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0ce5d-fb1f-4e60-9a40-dd3306910b30 None admin] PATH_INFO: `/v3/domains/d7aeaaf854984001b3420a208fea2d9e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:28.427104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0ce5d-fb1f-4e60-9a40-dd3306910b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d7aeaaf854984001b3420a208fea2d9e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:28.428562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0ce5d-fb1f-4e60-9a40-dd3306910b30 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:28.430155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 584/1172] 10.222.0.13 () {56 vars in 1183 bytes} [Mon Jun 20 05:56:28 2022] GET /identity/v3/domains/d7aeaaf854984001b3420a208fea2d9e => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:28.436125 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6dd1d-1e2d-4c7a-860d-1efc5b36016c None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:28.533306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6dd1d-1e2d-4c7a-860d-1efc5b36016c None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:28.565982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c03023-4c04-40b1-ab42-fa32d7ac9e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:28.566630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03023-4c04-40b1-ab42-fa32d7ac9e41 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:28.566917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03023-4c04-40b1-ab42-fa32d7ac9e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:28.567195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03023-4c04-40b1-ab42-fa32d7ac9e41 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:28.567910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c03023-4c04-40b1-ab42-fa32d7ac9e41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:28.569363 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c03023-4c04-40b1-ab42-fa32d7ac9e41 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:28.592986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 589/1173] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:56:28 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:56:30.620817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5feed-f323-48b6-8b13-c3ea8892542e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:30.621348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5feed-f323-48b6-8b13-c3ea8892542e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:30.621443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5feed-f323-48b6-8b13-c3ea8892542e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:30.622743 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 585/1174] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:30.627901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f54d0-9e4d-46f1-825a-a5a0cacb77ce None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:30.628306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f54d0-9e4d-46f1-825a-a5a0cacb77ce None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:30.628494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f54d0-9e4d-46f1-825a-a5a0cacb77ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:30.644839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-7c8f54d0-9e4d-46f1-825a-a5a0cacb77ce None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:30.646016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7c8f54d0-9e4d-46f1-825a-a5a0cacb77ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:30.660262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:30.714927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 590/1175] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:30.740811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5feed-f323-48b6-8b13-c3ea8892542e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:30.836676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5feed-f323-48b6-8b13-c3ea8892542e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:30.868064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a5e99-4419-4aa7-8f5f-c017872a88ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:30.868929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a5e99-4419-4aa7-8f5f-c017872a88ec None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:30.869208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a5e99-4419-4aa7-8f5f-c017872a88ec None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:30.869479 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a5e99-4419-4aa7-8f5f-c017872a88ec None admin] PATH_INFO: `/v3/domains/d7aeaaf854984001b3420a208fea2d9e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:30.870625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a5e99-4419-4aa7-8f5f-c017872a88ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=d7aeaaf854984001b3420a208fea2d9e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:30.872083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a5e99-4419-4aa7-8f5f-c017872a88ec None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:30.873624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 586/1176] 10.222.0.13 () {56 vars in 1183 bytes} [Mon Jun 20 05:56:30 2022] GET /identity/v3/domains/d7aeaaf854984001b3420a208fea2d9e => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:30.879176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f54d0-9e4d-46f1-825a-a5a0cacb77ce None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:30.974043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f54d0-9e4d-46f1-825a-a5a0cacb77ce None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:31.006388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95faa1c-c2cb-410b-8a92-9041956709d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:31.007049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95faa1c-c2cb-410b-8a92-9041956709d1 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:31.007338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95faa1c-c2cb-410b-8a92-9041956709d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:31.007618 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95faa1c-c2cb-410b-8a92-9041956709d1 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:31.008361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95faa1c-c2cb-410b-8a92-9041956709d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:31.009791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95faa1c-c2cb-410b-8a92-9041956709d1 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:31.030630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 591/1177] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:56:30 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:56:33.076188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185663a-0335-4e5b-bc10-b214c82dc05b None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:33.076809 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185663a-0335-4e5b-bc10-b214c82dc05b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:33.076809 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185663a-0335-4e5b-bc10-b214c82dc05b None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:33.078126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 587/1178] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:33.083801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033ef0-716d-419e-8e7d-a5ed694d0052 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:33.084231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033ef0-716d-419e-8e7d-a5ed694d0052 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:33.084433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033ef0-716d-419e-8e7d-a5ed694d0052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:33.102605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:33.108257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4e033ef0-716d-419e-8e7d-a5ed694d0052 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:33.109596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4e033ef0-716d-419e-8e7d-a5ed694d0052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:33.173467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 592/1179] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:33.197170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185663a-0335-4e5b-bc10-b214c82dc05b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:33.219074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:33.297347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185663a-0335-4e5b-bc10-b214c82dc05b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:33.328621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73212a0-f28c-41ad-862a-a5a19344bf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:33.329350 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73212a0-f28c-41ad-862a-a5a19344bf35 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:33.329664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73212a0-f28c-41ad-862a-a5a19344bf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:33.329944 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73212a0-f28c-41ad-862a-a5a19344bf35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:33.340644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73212a0-f28c-41ad-862a-a5a19344bf35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-a73212a0-f28c-41ad-862a-a5a19344bf35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:56:33.348764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:56:33.349996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:56:33.351245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 588/1180] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:56:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:56:33.355852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e033ef0-716d-419e-8e7d-a5ed694d0052 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:33.452098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e033ef0-716d-419e-8e7d-a5ed694d0052 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:33.486064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49a56e-d9c1-4d55-85b7-22b98832782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:33.486723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a56e-d9c1-4d55-85b7-22b98832782e None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:33.487036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a56e-d9c1-4d55-85b7-22b98832782e None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:33.487312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49a56e-d9c1-4d55-85b7-22b98832782e None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:33.488059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49a56e-d9c1-4d55-85b7-22b98832782e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:33.488396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49a56e-d9c1-4d55-85b7-22b98832782e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:33.489771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49a56e-d9c1-4d55-85b7-22b98832782e None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:33.491879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:33.498210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 593/1181] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:56:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:33.504439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73212a0-f28c-41ad-862a-a5a19344bf35 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:33.582298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:33.600657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73212a0-f28c-41ad-862a-a5a19344bf35 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:33.632415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814f3d-ed4b-4a0b-a8c9-93cc0c8e21df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:33.633262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814f3d-ed4b-4a0b-a8c9-93cc0c8e21df None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:33.633542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814f3d-ed4b-4a0b-a8c9-93cc0c8e21df None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:33.633811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814f3d-ed4b-4a0b-a8c9-93cc0c8e21df None admin] PATH_INFO: `/v3/users/81f42a76092f4a148568f63d8841eb9a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:33.646686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09814f3d-ed4b-4a0b-a8c9-93cc0c8e21df None admin] RBAC: Authorizing `identity:get_user(user_id=81f42a76092f4a148568f63d8841eb9a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:33.648108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09814f3d-ed4b-4a0b-a8c9-93cc0c8e21df None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:33.650003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 589/1182] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:33 2022] GET /identity/v3/users/81f42a76092f4a148568f63d8841eb9a => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:33.655610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49a56e-d9c1-4d55-85b7-22b98832782e None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:33.756760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49a56e-d9c1-4d55-85b7-22b98832782e None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:33.788408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1307-3a67-4c84-ab9b-fe8e88b3d79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:33.789038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1307-3a67-4c84-ab9b-fe8e88b3d79b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:33.789319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1307-3a67-4c84-ab9b-fe8e88b3d79b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:33.789591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1307-3a67-4c84-ab9b-fe8e88b3d79b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:33.849741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:33.853848 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c1307-3a67-4c84-ab9b-fe8e88b3d79b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:33.855275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c1307-3a67-4c84-ab9b-fe8e88b3d79b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:33.951231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 594/1183] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:56:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:33.957695 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814f3d-ed4b-4a0b-a8c9-93cc0c8e21df None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:34.057201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814f3d-ed4b-4a0b-a8c9-93cc0c8e21df None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:34.089376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae1754-d2a6-483b-8513-0daa4b0ac6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:34.090210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae1754-d2a6-483b-8513-0daa4b0ac6ed None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:34.090490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae1754-d2a6-483b-8513-0daa4b0ac6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:34.090764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae1754-d2a6-483b-8513-0daa4b0ac6ed None admin] PATH_INFO: `/v3/projects/2674b78ae8cf4eb687610a1aaa397b70` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:34.091913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae1754-d2a6-483b-8513-0daa4b0ac6ed None admin] RBAC: Authorizing `identity:get_project(project_id=2674b78ae8cf4eb687610a1aaa397b70)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:34.093368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae1754-d2a6-483b-8513-0daa4b0ac6ed None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:34.095021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 590/1184] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:56:33 2022] GET /identity/v3/projects/2674b78ae8cf4eb687610a1aaa397b70 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:34.103909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1307-3a67-4c84-ab9b-fe8e88b3d79b None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:34.204441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:34.208800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1307-3a67-4c84-ab9b-fe8e88b3d79b None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:34.241545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb49b8-be97-4a9c-843d-daca0bde0cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:34.242209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb49b8-be97-4a9c-843d-daca0bde0cec None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:34.242515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb49b8-be97-4a9c-843d-daca0bde0cec None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:34.242792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb49b8-be97-4a9c-843d-daca0bde0cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:34.243626 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb49b8-be97-4a9c-843d-daca0bde0cec None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=2674b78ae8cf4eb687610a1aaa397b70, user.id=81f42a76092f4a148568f63d8841eb9a) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:34.243940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb49b8-be97-4a9c-843d-daca0bde0cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:34.245402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb49b8-be97-4a9c-843d-daca0bde0cec None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:34.250756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 595/1185] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:56:34 2022] GET /identity/v3/role_assignments?user.id=81f42a76092f4a148568f63d8841eb9a&scope.project.id=2674b78ae8cf4eb687610a1aaa397b70&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:36.226863 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313c2e6-69ba-4cbf-951c-b0314c77d1a7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:36.227422 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313c2e6-69ba-4cbf-951c-b0314c77d1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:36.227422 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313c2e6-69ba-4cbf-951c-b0314c77d1a7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:36.228842 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 591/1186] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:36.233950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb8a73-6440-4c5c-8f87-01cde1d35a60 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:36.234364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb8a73-6440-4c5c-8f87-01cde1d35a60 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:36.234513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb8a73-6440-4c5c-8f87-01cde1d35a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:36.251390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-fbbb8a73-6440-4c5c-8f87-01cde1d35a60 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:36.253441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-fbbb8a73-6440-4c5c-8f87-01cde1d35a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:36.318201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 596/1187] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:36.340270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313c2e6-69ba-4cbf-951c-b0314c77d1a7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:36.348905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:36.440790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313c2e6-69ba-4cbf-951c-b0314c77d1a7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:36.477747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758606-6f16-47f0-8038-28a715bf7d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:36.478463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758606-6f16-47f0-8038-28a715bf7d46 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:36.478748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758606-6f16-47f0-8038-28a715bf7d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:36.479023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758606-6f16-47f0-8038-28a715bf7d46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:36.491368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41758606-6f16-47f0-8038-28a715bf7d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-41758606-6f16-47f0-8038-28a715bf7d46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:56:36.498847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:56:36.499922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:56:36.501006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 592/1188] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:56:36.506950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb8a73-6440-4c5c-8f87-01cde1d35a60 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:36.593342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:36.601911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb8a73-6440-4c5c-8f87-01cde1d35a60 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:36.634844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c66b22-9c89-4156-affc-e33a64c9880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:36.635493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66b22-9c89-4156-affc-e33a64c9880a None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:36.635778 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66b22-9c89-4156-affc-e33a64c9880a None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:36.636054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c66b22-9c89-4156-affc-e33a64c9880a None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:36.636837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c66b22-9c89-4156-affc-e33a64c9880a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:36.637150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c66b22-9c89-4156-affc-e33a64c9880a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:36.638506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c66b22-9c89-4156-affc-e33a64c9880a None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:36.646770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 597/1189] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:56:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:36.652602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758606-6f16-47f0-8038-28a715bf7d46 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:36.714979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:36.749322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758606-6f16-47f0-8038-28a715bf7d46 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:36.781082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a9fd1-4237-4fc8-973b-d7375993e28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:36.781924 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a9fd1-4237-4fc8-973b-d7375993e28d None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:36.782201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a9fd1-4237-4fc8-973b-d7375993e28d None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:36.782470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a9fd1-4237-4fc8-973b-d7375993e28d None admin] PATH_INFO: `/v3/users/81f42a76092f4a148568f63d8841eb9a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:36.783625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a9fd1-4237-4fc8-973b-d7375993e28d None admin] RBAC: Authorizing `identity:get_user(user_id=81f42a76092f4a148568f63d8841eb9a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:36.785239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a9fd1-4237-4fc8-973b-d7375993e28d None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:36.786834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 593/1190] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:36 2022] GET /identity/v3/users/81f42a76092f4a148568f63d8841eb9a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:36.792489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c66b22-9c89-4156-affc-e33a64c9880a None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:36.889047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c66b22-9c89-4156-affc-e33a64c9880a None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:36.920580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7ad96-4639-4c86-88f6-8b8d0c34b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:36.921425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7ad96-4639-4c86-88f6-8b8d0c34b2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:36.921707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7ad96-4639-4c86-88f6-8b8d0c34b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:36.921983 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7ad96-4639-4c86-88f6-8b8d0c34b2b4 None admin] PATH_INFO: `/v3/projects/2674b78ae8cf4eb687610a1aaa397b70` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:36.923148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7ad96-4639-4c86-88f6-8b8d0c34b2b4 None admin] RBAC: Authorizing `identity:get_project(project_id=2674b78ae8cf4eb687610a1aaa397b70)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:36.925114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7ad96-4639-4c86-88f6-8b8d0c34b2b4 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:36.926797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 598/1191] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:56:36 2022] GET /identity/v3/projects/2674b78ae8cf4eb687610a1aaa397b70 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:36.932724 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a9fd1-4237-4fc8-973b-d7375993e28d None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:37.028904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a9fd1-4237-4fc8-973b-d7375993e28d None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:37.060296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07447604-8bc3-4e5a-bbff-88d1bf67ed93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:37.061180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07447604-8bc3-4e5a-bbff-88d1bf67ed93 None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:37.061454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07447604-8bc3-4e5a-bbff-88d1bf67ed93 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:37.061721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07447604-8bc3-4e5a-bbff-88d1bf67ed93 None admin] PATH_INFO: `/v3/projects/2674b78ae8cf4eb687610a1aaa397b70/users/81f42a76092f4a148568f63d8841eb9a/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:37.063634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07447604-8bc3-4e5a-bbff-88d1bf67ed93 None admin] RBAC: Authorizing `identity:create_grant(project_id=2674b78ae8cf4eb687610a1aaa397b70, user_id=81f42a76092f4a148568f63d8841eb9a, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:37.065652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07447604-8bc3-4e5a-bbff-88d1bf67ed93 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:37.067778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:37.078632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 594/1192] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:56:36 2022] PUT /identity/v3/projects/2674b78ae8cf4eb687610a1aaa397b70/users/81f42a76092f4a148568f63d8841eb9a/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:56:39.052068 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde785eb-263a-4fa4-afe1-93ffb7e66c34 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:39.052679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde785eb-263a-4fa4-afe1-93ffb7e66c34 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:39.052679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde785eb-263a-4fa4-afe1-93ffb7e66c34 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:39.054003 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 599/1193] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:56:39.059035 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209abf1b-da80-4371-acee-09ae5f96aded None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:39.059427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209abf1b-da80-4371-acee-09ae5f96aded None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:39.059597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209abf1b-da80-4371-acee-09ae5f96aded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:39.076670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-209abf1b-da80-4371-acee-09ae5f96aded None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:56:39.077857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-209abf1b-da80-4371-acee-09ae5f96aded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:56:39.141494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 595/1194] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:56:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:56:39.164658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde785eb-263a-4fa4-afe1-93ffb7e66c34 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:39.188635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:39.262913 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde785eb-263a-4fa4-afe1-93ffb7e66c34 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:39.294855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c69c81-4637-470f-a538-d57a891eef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:39.295636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c69c81-4637-470f-a538-d57a891eef30 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:39.295921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c69c81-4637-470f-a538-d57a891eef30 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:39.296195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c69c81-4637-470f-a538-d57a891eef30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:39.306975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c69c81-4637-470f-a538-d57a891eef30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-69c69c81-4637-470f-a538-d57a891eef30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:56:39.314398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:56:39.315483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:56:39.316417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 600/1195] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:56:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:56:39.322257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209abf1b-da80-4371-acee-09ae5f96aded None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:39.416822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209abf1b-da80-4371-acee-09ae5f96aded None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:39.439224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:39.450621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7c0fe-abf0-4a76-93f4-d4329f241b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:39.451278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7c0fe-abf0-4a76-93f4-d4329f241b62 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:39.451565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7c0fe-abf0-4a76-93f4-d4329f241b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:39.451841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7c0fe-abf0-4a76-93f4-d4329f241b62 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:39.452614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7c0fe-abf0-4a76-93f4-d4329f241b62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:39.452921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7c0fe-abf0-4a76-93f4-d4329f241b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:39.454276 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7c0fe-abf0-4a76-93f4-d4329f241b62 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:39.462571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 596/1196] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:56:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:39.468342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c69c81-4637-470f-a538-d57a891eef30 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:39.547227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:39.565494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c69c81-4637-470f-a538-d57a891eef30 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:39.597511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4791f-d426-41c8-9dfe-c6450a41acb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:39.598357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4791f-d426-41c8-9dfe-c6450a41acb7 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:39.598636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4791f-d426-41c8-9dfe-c6450a41acb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:39.598911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4791f-d426-41c8-9dfe-c6450a41acb7 None admin] PATH_INFO: `/v3/users/81f42a76092f4a148568f63d8841eb9a` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:39.600070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4791f-d426-41c8-9dfe-c6450a41acb7 None admin] RBAC: Authorizing `identity:get_user(user_id=81f42a76092f4a148568f63d8841eb9a)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:39.601524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4791f-d426-41c8-9dfe-c6450a41acb7 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:39.603115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 601/1197] 10.222.0.13 () {56 vars in 1177 bytes} [Mon Jun 20 05:56:39 2022] GET /identity/v3/users/81f42a76092f4a148568f63d8841eb9a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:39.608817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7c0fe-abf0-4a76-93f4-d4329f241b62 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:39.705361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7c0fe-abf0-4a76-93f4-d4329f241b62 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:39.737559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79256937-074d-4030-8f26-e3c9121c91e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:39.738191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256937-074d-4030-8f26-e3c9121c91e9 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:39.738476 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256937-074d-4030-8f26-e3c9121c91e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:39.738752 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256937-074d-4030-8f26-e3c9121c91e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:39.790607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:39.804562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79256937-074d-4030-8f26-e3c9121c91e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:39.806004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79256937-074d-4030-8f26-e3c9121c91e9 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:39.900892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 597/1198] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:56:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:56:39.906615 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4791f-d426-41c8-9dfe-c6450a41acb7 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:40.002074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4791f-d426-41c8-9dfe-c6450a41acb7 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:40.035078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a98ec0-9d6a-49b5-af76-5871ab80d24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:40.035921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a98ec0-9d6a-49b5-af76-5871ab80d24b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:40.036207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a98ec0-9d6a-49b5-af76-5871ab80d24b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:40.036515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a98ec0-9d6a-49b5-af76-5871ab80d24b None admin] PATH_INFO: `/v3/projects/2674b78ae8cf4eb687610a1aaa397b70` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:40.037695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a98ec0-9d6a-49b5-af76-5871ab80d24b None admin] RBAC: Authorizing `identity:get_project(project_id=2674b78ae8cf4eb687610a1aaa397b70)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:40.039134 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a98ec0-9d6a-49b5-af76-5871ab80d24b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:40.040861 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 602/1199] 10.222.0.13 () {56 vars in 1186 bytes} [Mon Jun 20 05:56:39 2022] GET /identity/v3/projects/2674b78ae8cf4eb687610a1aaa397b70 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:40.046810 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79256937-074d-4030-8f26-e3c9121c91e9 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:56:40.127982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:40.142658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79256937-074d-4030-8f26-e3c9121c91e9 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:56:40.176026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7383a07-097a-45e8-91cb-a22f1370caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:56:40.176639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7383a07-097a-45e8-91cb-a22f1370caa8 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:56:40.176919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7383a07-097a-45e8-91cb-a22f1370caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:56:40.177191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7383a07-097a-45e8-91cb-a22f1370caa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:56:40.178006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7383a07-097a-45e8-91cb-a22f1370caa8 None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=2674b78ae8cf4eb687610a1aaa397b70, user.id=81f42a76092f4a148568f63d8841eb9a) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:56:40.178313 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7383a07-097a-45e8-91cb-a22f1370caa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:56:40.179713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7383a07-097a-45e8-91cb-a22f1370caa8 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:56:40.185352 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 598/1200] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:56:40 2022] GET /identity/v3/role_assignments?user.id=81f42a76092f4a148568f63d8841eb9a&scope.project.id=2674b78ae8cf4eb687610a1aaa397b70&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:56:50.030998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=91 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:56:50.182792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=25 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:35.245157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20963e54-de2a-4444-b190-741a8ba563fe None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.245669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20963e54-de2a-4444-b190-741a8ba563fe None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.245669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20963e54-de2a-4444-b190-741a8ba563fe None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.247042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 603/1201] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:35.253713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17466-4296-48b7-9653-d7e18c133f35 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.254164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17466-4296-48b7-9653-d7e18c133f35 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.254409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e17466-4296-48b7-9653-d7e18c133f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.276117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f8e17466-4296-48b7-9653-d7e18c133f35 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:35.277688 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f8e17466-4296-48b7-9653-d7e18c133f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:35.383436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 599/1202] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:57:35.413036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20963e54-de2a-4444-b190-741a8ba563fe None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.581038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20963e54-de2a-4444-b190-741a8ba563fe None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:35.629690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060db83f-acfd-49d2-b790-469233cdf02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.630760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060db83f-acfd-49d2-b790-469233cdf02f None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.631047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060db83f-acfd-49d2-b790-469233cdf02f None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.631326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060db83f-acfd-49d2-b790-469233cdf02f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.646384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060db83f-acfd-49d2-b790-469233cdf02f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:35.648027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060db83f-acfd-49d2-b790-469233cdf02f None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-060db83f-acfd-49d2-b790-469233cdf02f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:35.670927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:35.672110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:35.677493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:35.677493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:35.677493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:35.677493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:35.677493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 604/1203] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:35.678296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e17466-4296-48b7-9653-d7e18c133f35 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.808433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e17466-4296-48b7-9653-d7e18c133f35 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:35.849402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:35.857402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48f9a0-35bd-4326-8acc-65567390cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:35.858499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48f9a0-35bd-4326-8acc-65567390cedd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:35.859705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48f9a0-35bd-4326-8acc-65567390cedd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:35.860100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48f9a0-35bd-4326-8acc-65567390cedd None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:35.860909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48f9a0-35bd-4326-8acc-65567390cedd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:35.861240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48f9a0-35bd-4326-8acc-65567390cedd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:35.862617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48f9a0-35bd-4326-8acc-65567390cedd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:35.877978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 600/1204] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:35.883627 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060db83f-acfd-49d2-b790-469233cdf02f None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:35.967081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:36.033783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060db83f-acfd-49d2-b790-469233cdf02f None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:36.081963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43778a-9a9a-4ed2-a6d6-3c3827007267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:36.082654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43778a-9a9a-4ed2-a6d6-3c3827007267 None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:36.083059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43778a-9a9a-4ed2-a6d6-3c3827007267 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:36.083384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43778a-9a9a-4ed2-a6d6-3c3827007267 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:36.084139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43778a-9a9a-4ed2-a6d6-3c3827007267 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:36.085805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43778a-9a9a-4ed2-a6d6-3c3827007267 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:36.120379 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 605/1205] 10.222.0.13 () {60 vars in 1132 bytes} [Mon Jun 20 05:57:35 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:57:38.333624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a50d7-fe89-4e42-895a-5ecc303254c2 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.334193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a50d7-fe89-4e42-895a-5ecc303254c2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.334193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a50d7-fe89-4e42-895a-5ecc303254c2 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.335574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 601/1206] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:57:38.340798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e761d-9a35-4732-8ad8-81e16f9a7992 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.341580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e761d-9a35-4732-8ad8-81e16f9a7992 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.341580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e761d-9a35-4732-8ad8-81e16f9a7992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.367551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-650e761d-9a35-4732-8ad8-81e16f9a7992 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:38.368836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-650e761d-9a35-4732-8ad8-81e16f9a7992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:38.450723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 606/1207] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:57:38.477285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a50d7-fe89-4e42-895a-5ecc303254c2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.596791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a50d7-fe89-4e42-895a-5ecc303254c2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.644142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26ea82-392d-4ff6-a51f-5ea5c7125e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.644968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26ea82-392d-4ff6-a51f-5ea5c7125e5f None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.645287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26ea82-392d-4ff6-a51f-5ea5c7125e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.645564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26ea82-392d-4ff6-a51f-5ea5c7125e5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.658778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26ea82-392d-4ff6-a51f-5ea5c7125e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-ca26ea82-392d-4ff6-a51f-5ea5c7125e5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:38.667067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:38.668109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:38.668985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 602/1208] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:38.674656 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e761d-9a35-4732-8ad8-81e16f9a7992 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.718815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.787599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e761d-9a35-4732-8ad8-81e16f9a7992 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:38.823552 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897d2fa-b6ef-49c3-b916-8c04c482cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:38.824296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d2fa-b6ef-49c3-b916-8c04c482cf65 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:38.824617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d2fa-b6ef-49c3-b916-8c04c482cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:38.824895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d2fa-b6ef-49c3-b916-8c04c482cf65 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:38.825748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897d2fa-b6ef-49c3-b916-8c04c482cf65 None admin] RBAC: Adding query filter params (name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:38.826060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897d2fa-b6ef-49c3-b916-8c04c482cf65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:38.827552 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897d2fa-b6ef-49c3-b916-8c04c482cf65 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:38.836725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 607/1209] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:38.842251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26ea82-392d-4ff6-a51f-5ea5c7125e5f None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:38.900227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:38.961029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26ea82-392d-4ff6-a51f-5ea5c7125e5f None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.008422 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008717c-e345-4ea0-9af1-9f302a5e933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.009310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008717c-e345-4ea0-9af1-9f302a5e933c None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.009623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008717c-e345-4ea0-9af1-9f302a5e933c None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.009979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008717c-e345-4ea0-9af1-9f302a5e933c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.023101 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008717c-e345-4ea0-9af1-9f302a5e933c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.025168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008717c-e345-4ea0-9af1-9f302a5e933c None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-b008717c-e345-4ea0-9af1-9f302a5e933c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:39.043859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:39.045030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:39.046107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:39.046107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:39.046107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:39.046107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:39.046107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 603/1210] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:39.051879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897d2fa-b6ef-49c3-b916-8c04c482cf65 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.166139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.169638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897d2fa-b6ef-49c3-b916-8c04c482cf65 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.210249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3973ca-4bbd-4a6d-89c4-66d99ca1c1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.210984 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3973ca-4bbd-4a6d-89c4-66d99ca1c1cd None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.211276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3973ca-4bbd-4a6d-89c4-66d99ca1c1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.211585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3973ca-4bbd-4a6d-89c4-66d99ca1c1cd None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.212415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3973ca-4bbd-4a6d-89c4-66d99ca1c1cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:39.212797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3973ca-4bbd-4a6d-89c4-66d99ca1c1cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.214426 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3973ca-4bbd-4a6d-89c4-66d99ca1c1cd None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.229082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 608/1211] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:39.235714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008717c-e345-4ea0-9af1-9f302a5e933c None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.348604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008717c-e345-4ea0-9af1-9f302a5e933c None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.352533 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.394142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b439f5e-6747-4bd3-be3f-69c4609d5488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.395138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b439f5e-6747-4bd3-be3f-69c4609d5488 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.395468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b439f5e-6747-4bd3-be3f-69c4609d5488 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.395912 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b439f5e-6747-4bd3-be3f-69c4609d5488 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.404453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b439f5e-6747-4bd3-be3f-69c4609d5488 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.406012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b439f5e-6747-4bd3-be3f-69c4609d5488 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-5b439f5e-6747-4bd3-be3f-69c4609d5488 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:57:39.423389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:39.424477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:39.425464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:39.425464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:39.425464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:57:39.425464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:57:39.425464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:57:39.425464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:57:39.425464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:57:39.425464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:57:39.425464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:57:39.425464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:39.426029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 604/1212] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:39.432124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3973ca-4bbd-4a6d-89c4-66d99ca1c1cd None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.560696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3973ca-4bbd-4a6d-89c4-66d99ca1c1cd None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.603150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b1852-a139-4f35-a736-94e6b4965012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.603844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1852-a139-4f35-a736-94e6b4965012 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.604126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1852-a139-4f35-a736-94e6b4965012 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.604453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b1852-a139-4f35-a736-94e6b4965012 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.605434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b1852-a139-4f35-a736-94e6b4965012 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:39.605734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b1852-a139-4f35-a736-94e6b4965012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.607286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b1852-a139-4f35-a736-94e6b4965012 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:39.632997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 609/1213] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:39.643074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b439f5e-6747-4bd3-be3f-69c4609d5488 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:39.764848 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b439f5e-6747-4bd3-be3f-69c4609d5488 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:39.808582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b97588-3d21-46b9-90af-7d2de0859857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:39.809321 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b97588-3d21-46b9-90af-7d2de0859857 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:39.809616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b97588-3d21-46b9-90af-7d2de0859857 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:39.809902 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b97588-3d21-46b9-90af-7d2de0859857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:39.848021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:39.893094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b97588-3d21-46b9-90af-7d2de0859857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:39.894936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b97588-3d21-46b9-90af-7d2de0859857 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:40.018064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 605/1214] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:57:40.024108 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b1852-a139-4f35-a736-94e6b4965012 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:40.043799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:40.142110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b1852-a139-4f35-a736-94e6b4965012 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.186575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4743c0-8893-411e-9999-a7e2277f820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.187965 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4743c0-8893-411e-9999-a7e2277f820d None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.188296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4743c0-8893-411e-9999-a7e2277f820d None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.188607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4743c0-8893-411e-9999-a7e2277f820d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.199296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4743c0-8893-411e-9999-a7e2277f820d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:40.200971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4743c0-8893-411e-9999-a7e2277f820d None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-cf4743c0-8893-411e-9999-a7e2277f820d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:40.218250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:40.219373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:40.220423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:40.220423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:40.220423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:40.220423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:40.220423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 610/1215] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:40.225168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b97588-3d21-46b9-90af-7d2de0859857 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:40.294491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:40.342260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b97588-3d21-46b9-90af-7d2de0859857 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.378236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfcdb8-9552-4aea-bb8d-c1023a02c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.378917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfcdb8-9552-4aea-bb8d-c1023a02c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.379196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfcdb8-9552-4aea-bb8d-c1023a02c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.379558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfcdb8-9552-4aea-bb8d-c1023a02c2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.380293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfcdb8-9552-4aea-bb8d-c1023a02c2e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:40.380700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfcdb8-9552-4aea-bb8d-c1023a02c2e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:40.382075 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfcdb8-9552-4aea-bb8d-c1023a02c2e6 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:40.400609 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 606/1216] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:40.402336 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4743c0-8893-411e-9999-a7e2277f820d None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:40.485267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:40.525509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4743c0-8893-411e-9999-a7e2277f820d None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.562784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17660fd-917a-4468-be75-d04a585fe6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.563513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17660fd-917a-4468-be75-d04a585fe6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.563791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17660fd-917a-4468-be75-d04a585fe6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.564063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17660fd-917a-4468-be75-d04a585fe6b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.571408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17660fd-917a-4468-be75-d04a585fe6b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:40.572879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17660fd-917a-4468-be75-d04a585fe6b7 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-a17660fd-917a-4468-be75-d04a585fe6b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:57:40.587327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:40.588562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:40.589655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:57:40.589655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:57:40.589655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:57:40.589655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:57:40.589655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:57:40.589655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:57:40.589655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:57:40.589655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:40.589655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 611/1217] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:40.594547 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfcdb8-9552-4aea-bb8d-c1023a02c2e6 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:40.708243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfcdb8-9552-4aea-bb8d-c1023a02c2e6 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.733707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:40.750432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894200a-51d6-4762-a191-0d5ca8603f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.751163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894200a-51d6-4762-a191-0d5ca8603f57 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.751406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894200a-51d6-4762-a191-0d5ca8603f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.751886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894200a-51d6-4762-a191-0d5ca8603f57 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.752841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894200a-51d6-4762-a191-0d5ca8603f57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:40.753166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894200a-51d6-4762-a191-0d5ca8603f57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:40.754651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894200a-51d6-4762-a191-0d5ca8603f57 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:40.769544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 607/1218] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:40.776987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17660fd-917a-4468-be75-d04a585fe6b7 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:40.900256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17660fd-917a-4468-be75-d04a585fe6b7 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:40.934115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:40.942345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65339e6-4e43-419b-9d65-3f99906e331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:40.943019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65339e6-4e43-419b-9d65-3f99906e331b None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:40.943301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65339e6-4e43-419b-9d65-3f99906e331b None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:40.944616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65339e6-4e43-419b-9d65-3f99906e331b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:40.945520 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65339e6-4e43-419b-9d65-3f99906e331b None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=0a5e0b53aafc4bf3a23a7882ed12a89c) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:40.945865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65339e6-4e43-419b-9d65-3f99906e331b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:40.947321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65339e6-4e43-419b-9d65-3f99906e331b None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:40.955100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 612/1219] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:40 2022] GET /identity/v3/role_assignments?user.id=0a5e0b53aafc4bf3a23a7882ed12a89c&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:43.203944 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167a638-5a66-49ca-a0e9-2382f5fea5f0 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.204508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167a638-5a66-49ca-a0e9-2382f5fea5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.204508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167a638-5a66-49ca-a0e9-2382f5fea5f0 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.205901 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 608/1220] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:43.211496 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2aa68-6e8a-4ab9-9da5-31d4e9e87813 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.211941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2aa68-6e8a-4ab9-9da5-31d4e9e87813 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.212035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2aa68-6e8a-4ab9-9da5-31d4e9e87813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.230737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-6ff2aa68-6e8a-4ab9-9da5-31d4e9e87813 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:43.232213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6ff2aa68-6e8a-4ab9-9da5-31d4e9e87813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:43.312990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 613/1221] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 05:57:43.336175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167a638-5a66-49ca-a0e9-2382f5fea5f0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.442655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167a638-5a66-49ca-a0e9-2382f5fea5f0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.479640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fade2-1533-4a49-9d0a-93f44a8c86ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.480386 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fade2-1533-4a49-9d0a-93f44a8c86ef None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.480664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fade2-1533-4a49-9d0a-93f44a8c86ef None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.480952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fade2-1533-4a49-9d0a-93f44a8c86ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.490798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fade2-1533-4a49-9d0a-93f44a8c86ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-e67fade2-1533-4a49-9d0a-93f44a8c86ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:43.498439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:43.500038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:43.506150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 609/1222] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:43.506854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2aa68-6e8a-4ab9-9da5-31d4e9e87813 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.614993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2aa68-6e8a-4ab9-9da5-31d4e9e87813 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.639901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:43.654014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6af4e-c3ca-471f-8330-5bc4a05c6227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.654784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6af4e-c3ca-471f-8330-5bc4a05c6227 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.655074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6af4e-c3ca-471f-8330-5bc4a05c6227 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.655351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6af4e-c3ca-471f-8330-5bc4a05c6227 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.656874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6af4e-c3ca-471f-8330-5bc4a05c6227 None admin] RBAC: Adding query filter params (name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:43.657191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6af4e-c3ca-471f-8330-5bc4a05c6227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.658832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6af4e-c3ca-471f-8330-5bc4a05c6227 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.668814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 614/1223] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:43.675310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fade2-1533-4a49-9d0a-93f44a8c86ef None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.723816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:43.786507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fade2-1533-4a49-9d0a-93f44a8c86ef None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:43.822178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa24677-e390-4c8b-a9fa-9d126c7518d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:43.823027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24677-e390-4c8b-a9fa-9d126c7518d7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:43.823320 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24677-e390-4c8b-a9fa-9d126c7518d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:43.823643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24677-e390-4c8b-a9fa-9d126c7518d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:43.834644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa24677-e390-4c8b-a9fa-9d126c7518d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:43.836117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa24677-e390-4c8b-a9fa-9d126c7518d7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-9aa24677-e390-4c8b-a9fa-9d126c7518d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:43.854264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:43.855315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:43.856220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:43.856220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:43.856220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:43.856220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:43.856220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 610/1224] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:43.862183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6af4e-c3ca-471f-8330-5bc4a05c6227 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:43.975600 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6af4e-c3ca-471f-8330-5bc4a05c6227 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.019234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca327d-958a-45b5-a7bd-8d6651d294ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.020302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca327d-958a-45b5-a7bd-8d6651d294ff None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.020763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca327d-958a-45b5-a7bd-8d6651d294ff None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.021230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca327d-958a-45b5-a7bd-8d6651d294ff None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.022354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca327d-958a-45b5-a7bd-8d6651d294ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:44.022901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca327d-958a-45b5-a7bd-8d6651d294ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.025178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca327d-958a-45b5-a7bd-8d6651d294ff None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.041713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 615/1225] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:44.048027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa24677-e390-4c8b-a9fa-9d126c7518d7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.150194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:44.157205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa24677-e390-4c8b-a9fa-9d126c7518d7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.196092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e018cb-c38c-40ef-b5e8-15ba98cf5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.197024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e018cb-c38c-40ef-b5e8-15ba98cf5ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.197332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e018cb-c38c-40ef-b5e8-15ba98cf5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.197632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e018cb-c38c-40ef-b5e8-15ba98cf5ef4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.207033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e018cb-c38c-40ef-b5e8-15ba98cf5ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.208645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e018cb-c38c-40ef-b5e8-15ba98cf5ef4 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-72e018cb-c38c-40ef-b5e8-15ba98cf5ef4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:57:44.225643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:44.226976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:44.228031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:44.228031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:44.228031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:57:44.228031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:57:44.228031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:57:44.228031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:57:44.228031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:57:44.228031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:57:44.228031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:57:44.228031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:44.228031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 611/1226] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:44.233441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca327d-958a-45b5-a7bd-8d6651d294ff None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.287850 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:44.346994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca327d-958a-45b5-a7bd-8d6651d294ff None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.385345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34500f-888e-4e3d-b551-bd6b23f95ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.386022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34500f-888e-4e3d-b551-bd6b23f95ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.386305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34500f-888e-4e3d-b551-bd6b23f95ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.386595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34500f-888e-4e3d-b551-bd6b23f95ca9 None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.387434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34500f-888e-4e3d-b551-bd6b23f95ca9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:44.387749 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34500f-888e-4e3d-b551-bd6b23f95ca9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.389238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34500f-888e-4e3d-b551-bd6b23f95ca9 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.407266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 616/1227] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:44.412955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e018cb-c38c-40ef-b5e8-15ba98cf5ef4 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.522975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e018cb-c38c-40ef-b5e8-15ba98cf5ef4 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.557064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daacf41-8954-45d6-b39e-f122ff898910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.557819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daacf41-8954-45d6-b39e-f122ff898910 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.558161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daacf41-8954-45d6-b39e-f122ff898910 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.558385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daacf41-8954-45d6-b39e-f122ff898910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.569386 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daacf41-8954-45d6-b39e-f122ff898910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.570820 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daacf41-8954-45d6-b39e-f122ff898910 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-0daacf41-8954-45d6-b39e-f122ff898910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:44.589148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:44.590395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:44.591519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:44.591519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:44.591519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:44.591519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:44.591519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 612/1228] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:44.596846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34500f-888e-4e3d-b551-bd6b23f95ca9 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.703032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34500f-888e-4e3d-b551-bd6b23f95ca9 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.705454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:44.738402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aacaf2-6228-41d8-ace2-68ce44d75242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.739092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aacaf2-6228-41d8-ace2-68ce44d75242 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.739387 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aacaf2-6228-41d8-ace2-68ce44d75242 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.739667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aacaf2-6228-41d8-ace2-68ce44d75242 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.740438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aacaf2-6228-41d8-ace2-68ce44d75242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:44.740758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aacaf2-6228-41d8-ace2-68ce44d75242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.742137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aacaf2-6228-41d8-ace2-68ce44d75242 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.754283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 617/1229] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:44.760642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daacf41-8954-45d6-b39e-f122ff898910 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:44.771449 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:44.870098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daacf41-8954-45d6-b39e-f122ff898910 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:44.907099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26967d0-0511-4dc0-948f-c94d1f051665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:44.907938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26967d0-0511-4dc0-948f-c94d1f051665 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:44.908219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26967d0-0511-4dc0-948f-c94d1f051665 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:44.908518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26967d0-0511-4dc0-948f-c94d1f051665 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:44.915186 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26967d0-0511-4dc0-948f-c94d1f051665 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:44.916657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26967d0-0511-4dc0-948f-c94d1f051665 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-f26967d0-0511-4dc0-948f-c94d1f051665 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:57:44.930679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:44.931827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:44.932976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:57:44.932976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:57:44.932976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:57:44.932976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:57:44.932976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:57:44.932976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:57:44.932976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:57:44.932976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:44.932976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 613/1230] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:44.938378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aacaf2-6228-41d8-ace2-68ce44d75242 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.048082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aacaf2-6228-41d8-ace2-68ce44d75242 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:45.083714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d08ad2-6b1b-48e5-909f-f0164bed5237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:45.084454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d08ad2-6b1b-48e5-909f-f0164bed5237 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.084743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d08ad2-6b1b-48e5-909f-f0164bed5237 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.085020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d08ad2-6b1b-48e5-909f-f0164bed5237 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.085806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d08ad2-6b1b-48e5-909f-f0164bed5237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:45.086169 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d08ad2-6b1b-48e5-909f-f0164bed5237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:45.087611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d08ad2-6b1b-48e5-909f-f0164bed5237 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:45.100856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 618/1231] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:45.106920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26967d0-0511-4dc0-948f-c94d1f051665 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:45.178255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:45.215677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26967d0-0511-4dc0-948f-c94d1f051665 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:45.252340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c52e1f-ce6e-422e-9b4d-5980ebcc0a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:45.253239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52e1f-ce6e-422e-9b4d-5980ebcc0a5b None admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:45.253508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52e1f-ce6e-422e-9b4d-5980ebcc0a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:45.253790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c52e1f-ce6e-422e-9b4d-5980ebcc0a5b None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/0a5e0b53aafc4bf3a23a7882ed12a89c/roles/3b8809a605ba4173b9b96a4ef54212a2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:45.269374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c52e1f-ce6e-422e-9b4d-5980ebcc0a5b None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=0a5e0b53aafc4bf3a23a7882ed12a89c, role_id=3b8809a605ba4173b9b96a4ef54212a2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:45.271286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c52e1f-ce6e-422e-9b4d-5980ebcc0a5b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:45.287596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 614/1232] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:45 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/0a5e0b53aafc4bf3a23a7882ed12a89c/roles/3b8809a605ba4173b9b96a4ef54212a2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:57:47.437868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528d425-c268-4eca-868f-7d68ac021b7d None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.438418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528d425-c268-4eca-868f-7d68ac021b7d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.438510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528d425-c268-4eca-868f-7d68ac021b7d None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.440236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 619/1233] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:47.446110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410f9e-e5e6-416e-90ed-3a6e7f995d46 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.446531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410f9e-e5e6-416e-90ed-3a6e7f995d46 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.446666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a410f9e-e5e6-416e-90ed-3a6e7f995d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.463295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4a410f9e-e5e6-416e-90ed-3a6e7f995d46 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:47.464510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4a410f9e-e5e6-416e-90ed-3a6e7f995d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:47.542406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 615/1234] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:57:47.569962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528d425-c268-4eca-868f-7d68ac021b7d None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:47.602593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:47.682886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528d425-c268-4eca-868f-7d68ac021b7d None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:47.722161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1161b90-61aa-4e40-9068-9c848a412847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.722951 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161b90-61aa-4e40-9068-9c848a412847 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.723240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161b90-61aa-4e40-9068-9c848a412847 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.723616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1161b90-61aa-4e40-9068-9c848a412847 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.734861 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1161b90-61aa-4e40-9068-9c848a412847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-a1161b90-61aa-4e40-9068-9c848a412847 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:47.742889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:47.744081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:47.745229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 620/1235] 10.222.0.13 () {56 vars in 1102 bytes} [Mon Jun 20 05:57:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:47.750784 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a410f9e-e5e6-416e-90ed-3a6e7f995d46 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:47.800104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:47.855087 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a410f9e-e5e6-416e-90ed-3a6e7f995d46 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:47.896564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa6f06-8fc0-48bf-8cdf-3d353753f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:47.897292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6f06-8fc0-48bf-8cdf-3d353753f8ea None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:47.897676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6f06-8fc0-48bf-8cdf-3d353753f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:47.897971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6f06-8fc0-48bf-8cdf-3d353753f8ea None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:47.899616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa6f06-8fc0-48bf-8cdf-3d353753f8ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:47.900194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa6f06-8fc0-48bf-8cdf-3d353753f8ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:47.902283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa6f06-8fc0-48bf-8cdf-3d353753f8ea None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:47.911372 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 616/1236] 10.222.0.13 () {56 vars in 1103 bytes} [Mon Jun 20 05:57:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:47.917311 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1161b90-61aa-4e40-9068-9c848a412847 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.019146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.042323 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1161b90-61aa-4e40-9068-9c848a412847 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.080282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f34960-325c-44b8-880d-58697ecffef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.081032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f34960-325c-44b8-880d-58697ecffef5 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.081321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f34960-325c-44b8-880d-58697ecffef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.081602 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f34960-325c-44b8-880d-58697ecffef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.093341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f34960-325c-44b8-880d-58697ecffef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:48.095114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f34960-325c-44b8-880d-58697ecffef5 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-a4f34960-325c-44b8-880d-58697ecffef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:48.118769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:48.120835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:48.121909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:48.121909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:48.121909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:48.121909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:48.121909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 621/1237] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:48.126340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa6f06-8fc0-48bf-8cdf-3d353753f8ea None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.235131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa6f06-8fc0-48bf-8cdf-3d353753f8ea None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.246854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.274270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ac814-2ef4-4c5c-a17d-c3655ac9d315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.274931 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ac814-2ef4-4c5c-a17d-c3655ac9d315 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.275214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ac814-2ef4-4c5c-a17d-c3655ac9d315 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.275490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ac814-2ef4-4c5c-a17d-c3655ac9d315 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.276209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ac814-2ef4-4c5c-a17d-c3655ac9d315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:48.276546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ac814-2ef4-4c5c-a17d-c3655ac9d315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:48.277915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ac814-2ef4-4c5c-a17d-c3655ac9d315 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:48.289637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 617/1238] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:48.295575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f34960-325c-44b8-880d-58697ecffef5 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.411931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f34960-325c-44b8-880d-58697ecffef5 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.446999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e865308-76bb-47a7-b0aa-98088f98d1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.447814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e865308-76bb-47a7-b0aa-98088f98d1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.448085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e865308-76bb-47a7-b0aa-98088f98d1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.448381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e865308-76bb-47a7-b0aa-98088f98d1b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.451231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.457505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e865308-76bb-47a7-b0aa-98088f98d1b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:48.458944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e865308-76bb-47a7-b0aa-98088f98d1b2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-2e865308-76bb-47a7-b0aa-98088f98d1b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:57:48.474235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:48.475291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:48.476724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:48.476724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:48.476724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:57:48.476724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:57:48.476724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:57:48.476724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:57:48.476724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:57:48.476724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:57:48.476724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:57:48.476724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:48.476724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 622/1239] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:48.481396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ac814-2ef4-4c5c-a17d-c3655ac9d315 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.591925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ac814-2ef4-4c5c-a17d-c3655ac9d315 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.627956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c40177-387e-4f92-87f6-3d075fece8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.628732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40177-387e-4f92-87f6-3d075fece8fd None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.629011 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40177-387e-4f92-87f6-3d075fece8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.629312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c40177-387e-4f92-87f6-3d075fece8fd None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.630189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c40177-387e-4f92-87f6-3d075fece8fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:48.630532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c40177-387e-4f92-87f6-3d075fece8fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:48.632155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c40177-387e-4f92-87f6-3d075fece8fd None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:48.652044 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 618/1240] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:48.658127 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e865308-76bb-47a7-b0aa-98088f98d1b2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:48.767179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e865308-76bb-47a7-b0aa-98088f98d1b2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:48.803277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc381-b1f1-482b-9373-37582f58d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:48.803920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc381-b1f1-482b-9373-37582f58d960 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:48.804203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc381-b1f1-482b-9373-37582f58d960 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:48.804506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc381-b1f1-482b-9373-37582f58d960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:48.872872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:48.881343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcc381-b1f1-482b-9373-37582f58d960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:48.883039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcc381-b1f1-482b-9373-37582f58d960 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:48.998745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 623/1241] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 05:57:49.004284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c40177-387e-4f92-87f6-3d075fece8fd None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.038602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:49.122277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c40177-387e-4f92-87f6-3d075fece8fd None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.161050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959eb65-d541-4324-8bad-9c11b35e140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.161836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959eb65-d541-4324-8bad-9c11b35e140a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.162119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959eb65-d541-4324-8bad-9c11b35e140a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.162396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959eb65-d541-4324-8bad-9c11b35e140a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.173097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959eb65-d541-4324-8bad-9c11b35e140a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.174653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959eb65-d541-4324-8bad-9c11b35e140a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-b959eb65-d541-4324-8bad-9c11b35e140a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:49.193799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:49.199954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:49.201108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:49.201108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:49.201108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:49.201108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:49.201108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 619/1242] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:49.203192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc381-b1f1-482b-9373-37582f58d960 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.311786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:49.319357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc381-b1f1-482b-9373-37582f58d960 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.361168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872ee82-235d-44f6-af5f-cfa2cbfb47d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.362233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ee82-235d-44f6-af5f-cfa2cbfb47d3 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.362728 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ee82-235d-44f6-af5f-cfa2cbfb47d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.363205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ee82-235d-44f6-af5f-cfa2cbfb47d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.364421 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872ee82-235d-44f6-af5f-cfa2cbfb47d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:49.364785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872ee82-235d-44f6-af5f-cfa2cbfb47d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.366487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872ee82-235d-44f6-af5f-cfa2cbfb47d3 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.380894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 624/1243] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:49.387676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959eb65-d541-4324-8bad-9c11b35e140a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.480306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:49.504024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959eb65-d541-4324-8bad-9c11b35e140a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.546674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768fa5d-1ced-44ff-bb52-b0642cc6184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.547659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768fa5d-1ced-44ff-bb52-b0642cc6184b None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.548017 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768fa5d-1ced-44ff-bb52-b0642cc6184b None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.548355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768fa5d-1ced-44ff-bb52-b0642cc6184b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.556625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768fa5d-1ced-44ff-bb52-b0642cc6184b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.558131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768fa5d-1ced-44ff-bb52-b0642cc6184b None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-7768fa5d-1ced-44ff-bb52-b0642cc6184b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:57:49.575388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:49.577384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:49.579270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:57:49.579270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:57:49.579270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:57:49.579270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:57:49.579270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:57:49.579270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:57:49.579270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:57:49.579270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:49.579270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 620/1244] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:49.583727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872ee82-235d-44f6-af5f-cfa2cbfb47d3 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.700207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872ee82-235d-44f6-af5f-cfa2cbfb47d3 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.738942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa879c8b-f3e2-429e-84a2-19a4c040f826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.739741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa879c8b-f3e2-429e-84a2-19a4c040f826 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.740190 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa879c8b-f3e2-429e-84a2-19a4c040f826 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.740475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa879c8b-f3e2-429e-84a2-19a4c040f826 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.741334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa879c8b-f3e2-429e-84a2-19a4c040f826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:49.741787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa879c8b-f3e2-429e-84a2-19a4c040f826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.743342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa879c8b-f3e2-429e-84a2-19a4c040f826 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.756704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 625/1245] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:49.762716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768fa5d-1ced-44ff-bb52-b0642cc6184b None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:49.881390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768fa5d-1ced-44ff-bb52-b0642cc6184b None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:49.923243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036183c2-726d-4b65-b919-98c7fafaf99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:49.923905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036183c2-726d-4b65-b919-98c7fafaf99e None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:49.924192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036183c2-726d-4b65-b919-98c7fafaf99e None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:49.924504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036183c2-726d-4b65-b919-98c7fafaf99e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:49.925347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036183c2-726d-4b65-b919-98c7fafaf99e None admin] RBAC: Adding query filter params (role.id=3b8809a605ba4173b9b96a4ef54212a2, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=0a5e0b53aafc4bf3a23a7882ed12a89c) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:49.925664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036183c2-726d-4b65-b919-98c7fafaf99e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:49.927347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036183c2-726d-4b65-b919-98c7fafaf99e None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:49.934460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 621/1246] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:49 2022] GET /identity/v3/role_assignments?user.id=0a5e0b53aafc4bf3a23a7882ed12a89c&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=3b8809a605ba4173b9b96a4ef54212a2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:52.070997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67fc49-23a9-4b22-8edb-bad6020b6fa0 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.071548 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67fc49-23a9-4b22-8edb-bad6020b6fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.071548 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67fc49-23a9-4b22-8edb-bad6020b6fa0 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.072944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 626/1247] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:52.078129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b17494-2e9f-415a-8981-675b9662d573 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.078569 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b17494-2e9f-415a-8981-675b9662d573 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.078675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b17494-2e9f-415a-8981-675b9662d573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.083946 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.098805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b3b17494-2e9f-415a-8981-675b9662d573 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:52.100072 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b3b17494-2e9f-415a-8981-675b9662d573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:52.174301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 622/1248] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:57:52.198249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67fc49-23a9-4b22-8edb-bad6020b6fa0 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.216226 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.309508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67fc49-23a9-4b22-8edb-bad6020b6fa0 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.346290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1975-b85b-4196-ad2c-c6d33afd9fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.347313 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1975-b85b-4196-ad2c-c6d33afd9fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.347577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1975-b85b-4196-ad2c-c6d33afd9fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.347925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d1975-b85b-4196-ad2c-c6d33afd9fc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.359828 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d1975-b85b-4196-ad2c-c6d33afd9fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-4a4d1975-b85b-4196-ad2c-c6d33afd9fc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:52.369072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:52.371968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:52.373077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 627/1249] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 05:57:52.377856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b17494-2e9f-415a-8981-675b9662d573 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.486787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b17494-2e9f-415a-8981-675b9662d573 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.520188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.527644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47a5af-5efb-4fab-b09f-92255bd41554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.528670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47a5af-5efb-4fab-b09f-92255bd41554 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.528957 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47a5af-5efb-4fab-b09f-92255bd41554 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.529230 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47a5af-5efb-4fab-b09f-92255bd41554 None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.530730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47a5af-5efb-4fab-b09f-92255bd41554 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:52.531211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47a5af-5efb-4fab-b09f-92255bd41554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.533206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47a5af-5efb-4fab-b09f-92255bd41554 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.543947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 623/1250] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:52.550195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1975-b85b-4196-ad2c-c6d33afd9fc4 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.632297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:52.659412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d1975-b85b-4196-ad2c-c6d33afd9fc4 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.706271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae8212-7dd0-4ad3-b7af-e278fa1b4197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.707060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8212-7dd0-4ad3-b7af-e278fa1b4197 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.707339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8212-7dd0-4ad3-b7af-e278fa1b4197 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.707613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8212-7dd0-4ad3-b7af-e278fa1b4197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.719856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae8212-7dd0-4ad3-b7af-e278fa1b4197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.721338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae8212-7dd0-4ad3-b7af-e278fa1b4197 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-b7ae8212-7dd0-4ad3-b7af-e278fa1b4197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:52.742654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:52.744465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:52.746597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:52.746597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:52.746597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:52.746597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:52.746597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 628/1251] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:52.750899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47a5af-5efb-4fab-b09f-92255bd41554 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:52.888243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47a5af-5efb-4fab-b09f-92255bd41554 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:52.924542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a97fbc-30b5-47ac-8fa8-90f8bbb85290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:52.925207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a97fbc-30b5-47ac-8fa8-90f8bbb85290 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:52.925488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a97fbc-30b5-47ac-8fa8-90f8bbb85290 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:52.925764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a97fbc-30b5-47ac-8fa8-90f8bbb85290 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:52.926484 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a97fbc-30b5-47ac-8fa8-90f8bbb85290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:52.926817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a97fbc-30b5-47ac-8fa8-90f8bbb85290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:52.928210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a97fbc-30b5-47ac-8fa8-90f8bbb85290 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:52.940589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 624/1252] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 05:57:52.947401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae8212-7dd0-4ad3-b7af-e278fa1b4197 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.065238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae8212-7dd0-4ad3-b7af-e278fa1b4197 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.092341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.100845 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4479c6f-3663-4a3c-bc73-615cecc07293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.101648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4479c6f-3663-4a3c-bc73-615cecc07293 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.101934 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4479c6f-3663-4a3c-bc73-615cecc07293 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.102211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4479c6f-3663-4a3c-bc73-615cecc07293 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.110542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4479c6f-3663-4a3c-bc73-615cecc07293 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.112072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4479c6f-3663-4a3c-bc73-615cecc07293 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-c4479c6f-3663-4a3c-bc73-615cecc07293 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:57:53.128191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:53.129424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:53.130510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:53.130510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:53.130510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:57:53.130510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:57:53.130510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:57:53.130510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:57:53.130510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:57:53.130510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:57:53.130510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:57:53.130510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:53.130510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 629/1253] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:53.135193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a97fbc-30b5-47ac-8fa8-90f8bbb85290 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.200148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.251714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a97fbc-30b5-47ac-8fa8-90f8bbb85290 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.289050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ea55-3ff3-4f08-9497-d1edd25d38d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.289728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ea55-3ff3-4f08-9497-d1edd25d38d3 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.290015 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ea55-3ff3-4f08-9497-d1edd25d38d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.290289 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ea55-3ff3-4f08-9497-d1edd25d38d3 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.291128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1ea55-3ff3-4f08-9497-d1edd25d38d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:53.291527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1ea55-3ff3-4f08-9497-d1edd25d38d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.293176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1ea55-3ff3-4f08-9497-d1edd25d38d3 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.314020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 625/1254] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:53.319750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4479c6f-3663-4a3c-bc73-615cecc07293 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.425358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4479c6f-3663-4a3c-bc73-615cecc07293 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.460051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c9452-dd28-4e06-bb3f-528a14f0a4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.460608 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c9452-dd28-4e06-bb3f-528a14f0a4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.460894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c9452-dd28-4e06-bb3f-528a14f0a4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.461226 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c9452-dd28-4e06-bb3f-528a14f0a4d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.519775 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.535118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c9452-dd28-4e06-bb3f-528a14f0a4d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.536705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c9452-dd28-4e06-bb3f-528a14f0a4d5 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.642740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 630/1255] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:57:53.649118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ea55-3ff3-4f08-9497-d1edd25d38d3 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.771443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ea55-3ff3-4f08-9497-d1edd25d38d3 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:53.786680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.809202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb2365-2f9a-4c50-aafc-e304832d2f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:53.809988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb2365-2f9a-4c50-aafc-e304832d2f86 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:53.810279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb2365-2f9a-4c50-aafc-e304832d2f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:53.810556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb2365-2f9a-4c50-aafc-e304832d2f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:53.823751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb2365-2f9a-4c50-aafc-e304832d2f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:53.825336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb2365-2f9a-4c50-aafc-e304832d2f86 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-13eb2365-2f9a-4c50-aafc-e304832d2f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:53.844921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:53.845991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:53.847080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:53.847080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:53.847080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:53.847080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:53.847080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 626/1256] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:53.852963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c9452-dd28-4e06-bb3f-528a14f0a4d5 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:53.953301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:53.966386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c9452-dd28-4e06-bb3f-528a14f0a4d5 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.018714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27a2e5-af34-4379-a317-0dae3b006d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:54.019409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a2e5-af34-4379-a317-0dae3b006d39 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.019666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a2e5-af34-4379-a317-0dae3b006d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.019940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27a2e5-af34-4379-a317-0dae3b006d39 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.020716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27a2e5-af34-4379-a317-0dae3b006d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:54.021029 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27a2e5-af34-4379-a317-0dae3b006d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:54.022480 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27a2e5-af34-4379-a317-0dae3b006d39 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:54.036638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 631/1257] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:54.042260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb2365-2f9a-4c50-aafc-e304832d2f86 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:54.146473 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb2365-2f9a-4c50-aafc-e304832d2f86 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.182259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b9e4e-aed4-4b42-afb1-e0a92039d326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:54.183063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b9e4e-aed4-4b42-afb1-e0a92039d326 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.183348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b9e4e-aed4-4b42-afb1-e0a92039d326 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.183624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b9e4e-aed4-4b42-afb1-e0a92039d326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.191657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b9e4e-aed4-4b42-afb1-e0a92039d326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:54.193171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b9e4e-aed4-4b42-afb1-e0a92039d326 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-778b9e4e-aed4-4b42-afb1-e0a92039d326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:57:54.208036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:54.209104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:54.210006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:57:54.210006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:57:54.210006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:57:54.210006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:57:54.210006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:57:54.210006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:57:54.210006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:57:54.210006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:57:54.210006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 627/1258] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:54.215316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27a2e5-af34-4379-a317-0dae3b006d39 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:54.322941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27a2e5-af34-4379-a317-0dae3b006d39 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.356767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e9553-8902-419b-96ab-bf2c16f44079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:54.357432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e9553-8902-419b-96ab-bf2c16f44079 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.357718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e9553-8902-419b-96ab-bf2c16f44079 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.357996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e9553-8902-419b-96ab-bf2c16f44079 None admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.359355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e9553-8902-419b-96ab-bf2c16f44079 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:54.359670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e9553-8902-419b-96ab-bf2c16f44079 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:54.361135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e9553-8902-419b-96ab-bf2c16f44079 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:54.373199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 632/1259] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:57:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:54.381264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b9e4e-aed4-4b42-afb1-e0a92039d326 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:54.408360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:54.489448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b9e4e-aed4-4b42-afb1-e0a92039d326 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:54.523155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe06eeb-2137-41c5-b4bf-7e8184c07505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:54.524070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe06eeb-2137-41c5-b4bf-7e8184c07505 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:54.524383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe06eeb-2137-41c5-b4bf-7e8184c07505 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:54.524664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe06eeb-2137-41c5-b4bf-7e8184c07505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:54.525496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe06eeb-2137-41c5-b4bf-7e8184c07505 None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=0a5e0b53aafc4bf3a23a7882ed12a89c) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:54.525809 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe06eeb-2137-41c5-b4bf-7e8184c07505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:54.527242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe06eeb-2137-41c5-b4bf-7e8184c07505 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:54.533716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 628/1260] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:57:54 2022] GET /identity/v3/role_assignments?user.id=0a5e0b53aafc4bf3a23a7882ed12a89c&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:56.503023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650bba-3fa2-4412-82dd-9fbe2706abe9 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.503523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650bba-3fa2-4412-82dd-9fbe2706abe9 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.503523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650bba-3fa2-4412-82dd-9fbe2706abe9 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.504981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 633/1261] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:57:56.510198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df33e-5ed2-436c-bc65-2a71a1e9f051 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.510568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df33e-5ed2-436c-bc65-2a71a1e9f051 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.510749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797df33e-5ed2-436c-bc65-2a71a1e9f051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.528010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-797df33e-5ed2-436c-bc65-2a71a1e9f051 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:57:56.529221 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-797df33e-5ed2-436c-bc65-2a71a1e9f051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:57:56.592411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 629/1262] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:57:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:57:56.614362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f650bba-3fa2-4412-82dd-9fbe2706abe9 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:56.625384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:56.713053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f650bba-3fa2-4412-82dd-9fbe2706abe9 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:56.746574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b189b98-7b06-4bd2-b11e-cf4d15f6e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:56.747376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b189b98-7b06-4bd2-b11e-cf4d15f6e4ae None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.747658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b189b98-7b06-4bd2-b11e-cf4d15f6e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.747935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b189b98-7b06-4bd2-b11e-cf4d15f6e4ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.763773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b189b98-7b06-4bd2-b11e-cf4d15f6e4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-2b189b98-7b06-4bd2-b11e-cf4d15f6e4ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:57:56.771874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:56.772991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:56.779294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 634/1263] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:57:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:56.780144 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df33e-5ed2-436c-bc65-2a71a1e9f051 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:56.797589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:56.874885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797df33e-5ed2-436c-bc65-2a71a1e9f051 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:56.907255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b988d0e-916e-4cce-83c4-e25b59edb11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:56.907902 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b988d0e-916e-4cce-83c4-e25b59edb11a None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:56.908181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b988d0e-916e-4cce-83c4-e25b59edb11a None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:56.908492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b988d0e-916e-4cce-83c4-e25b59edb11a None admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:56.909227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b988d0e-916e-4cce-83c4-e25b59edb11a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:56.909530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b988d0e-916e-4cce-83c4-e25b59edb11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:56.910881 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b988d0e-916e-4cce-83c4-e25b59edb11a None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:56.918800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 630/1264] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:57:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:56.924840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b189b98-7b06-4bd2-b11e-cf4d15f6e4ae None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:56.991158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:57.033546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b189b98-7b06-4bd2-b11e-cf4d15f6e4ae None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:57.070987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682579cd-110d-437f-8664-57c161665a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.071773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682579cd-110d-437f-8664-57c161665a78 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.072058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682579cd-110d-437f-8664-57c161665a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.072358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682579cd-110d-437f-8664-57c161665a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.082485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682579cd-110d-437f-8664-57c161665a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:57.083936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682579cd-110d-437f-8664-57c161665a78 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-682579cd-110d-437f-8664-57c161665a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:57.100867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:57.101910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:57.103008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:57.103008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:57.103008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:57.103008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:57.103008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 635/1265] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:57.107792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b988d0e-916e-4cce-83c4-e25b59edb11a None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:57.185391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:57.204729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b988d0e-916e-4cce-83c4-e25b59edb11a None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:57.237420 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd639ea-33ad-4055-bdbf-fb944fff9836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.238077 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd639ea-33ad-4055-bdbf-fb944fff9836 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.238361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd639ea-33ad-4055-bdbf-fb944fff9836 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.238636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd639ea-33ad-4055-bdbf-fb944fff9836 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.239354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd639ea-33ad-4055-bdbf-fb944fff9836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:57.239666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd639ea-33ad-4055-bdbf-fb944fff9836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:57.241050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd639ea-33ad-4055-bdbf-fb944fff9836 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:57.252677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 631/1266] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:57.258230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682579cd-110d-437f-8664-57c161665a78 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:57.354759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682579cd-110d-437f-8664-57c161665a78 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:57.374487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:57.387957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df79b9-9609-4d84-85c1-07bb25a185b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.388771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df79b9-9609-4d84-85c1-07bb25a185b8 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.389054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df79b9-9609-4d84-85c1-07bb25a185b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.389362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df79b9-9609-4d84-85c1-07bb25a185b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.397001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df79b9-9609-4d84-85c1-07bb25a185b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:57.398685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df79b9-9609-4d84-85c1-07bb25a185b8 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-43df79b9-9609-4d84-85c1-07bb25a185b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:57:57.412373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:57.413325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:57.414306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:57.414306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:57.414306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:57:57.414306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:57:57.414306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:57:57.414306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:57:57.414306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:57:57.414306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:57:57.414306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:57:57.414306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:57.414306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 636/1267] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:57.419330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd639ea-33ad-4055-bdbf-fb944fff9836 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:57.515112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd639ea-33ad-4055-bdbf-fb944fff9836 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:57.547486 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72c376-d46d-4fad-ae4b-cec22d2c6e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.548134 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72c376-d46d-4fad-ae4b-cec22d2c6e46 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.548446 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72c376-d46d-4fad-ae4b-cec22d2c6e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.548721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72c376-d46d-4fad-ae4b-cec22d2c6e46 None admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.549545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72c376-d46d-4fad-ae4b-cec22d2c6e46 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:57.549852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72c376-d46d-4fad-ae4b-cec22d2c6e46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:57.551268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72c376-d46d-4fad-ae4b-cec22d2c6e46 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:57.559558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:57.568789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 632/1268] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:57.574247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df79b9-9609-4d84-85c1-07bb25a185b8 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:57.669551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df79b9-9609-4d84-85c1-07bb25a185b8 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:57.700698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c51fb3-7528-424e-8b6e-334d38e620cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.701471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c51fb3-7528-424e-8b6e-334d38e620cf None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.701754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c51fb3-7528-424e-8b6e-334d38e620cf None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.702542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c51fb3-7528-424e-8b6e-334d38e620cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.712559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c51fb3-7528-424e-8b6e-334d38e620cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:57.713989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c51fb3-7528-424e-8b6e-334d38e620cf None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-b3c51fb3-7528-424e-8b6e-334d38e620cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:57:57.730792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:57.731835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:57.732969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:57:57.732969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:57:57.732969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:57:57.732969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:57.732969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 637/1269] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:57.738131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72c376-d46d-4fad-ae4b-cec22d2c6e46 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:57.836292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72c376-d46d-4fad-ae4b-cec22d2c6e46 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:57.869227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7a1fa-4add-4889-ba3e-458cad4df627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:57.869874 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7a1fa-4add-4889-ba3e-458cad4df627 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:57.870153 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7a1fa-4add-4889-ba3e-458cad4df627 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:57.870425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7a1fa-4add-4889-ba3e-458cad4df627 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:57.871136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7a1fa-4add-4889-ba3e-458cad4df627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:57.871440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7a1fa-4add-4889-ba3e-458cad4df627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:57.872831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7a1fa-4add-4889-ba3e-458cad4df627 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:57.883551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 633/1270] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:57.889171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c51fb3-7528-424e-8b6e-334d38e620cf None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:57.920160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:57.990396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c51fb3-7528-424e-8b6e-334d38e620cf None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.027576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c0202-4189-4392-85fb-12da916c50cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:58.028379 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0202-4189-4392-85fb-12da916c50cc None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.028669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0202-4189-4392-85fb-12da916c50cc None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.028943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0202-4189-4392-85fb-12da916c50cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.035870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c0202-4189-4392-85fb-12da916c50cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:58.037346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c0202-4189-4392-85fb-12da916c50cc None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-487c0202-4189-4392-85fb-12da916c50cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:57:58.052425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:57:58.053456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:57:58.054577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:57:58.054577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:57:58.054577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:57:58.054577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:57:58.054577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:57:58.054577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:57:58.054577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:57:58.054577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:57:58.054577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 638/1271] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:57:58.059404 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7a1fa-4add-4889-ba3e-458cad4df627 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.120835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:58.161566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7a1fa-4add-4889-ba3e-458cad4df627 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.192807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e23c5d-520c-4a53-a049-a5061d030014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:58.193392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23c5d-520c-4a53-a049-a5061d030014 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.193673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23c5d-520c-4a53-a049-a5061d030014 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.193947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23c5d-520c-4a53-a049-a5061d030014 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.194720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e23c5d-520c-4a53-a049-a5061d030014 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:57:58.195025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e23c5d-520c-4a53-a049-a5061d030014 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:58.196475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e23c5d-520c-4a53-a049-a5061d030014 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:58.208445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 634/1272] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:57:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:57:58.214327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c0202-4189-4392-85fb-12da916c50cc None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:57:58.302016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:57:58.311099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c0202-4189-4392-85fb-12da916c50cc None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:57:58.343307 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4035e-dc59-4d56-9478-84d0c96f4123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:57:58.344172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4035e-dc59-4d56-9478-84d0c96f4123 None admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:57:58.344482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4035e-dc59-4d56-9478-84d0c96f4123 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:57:58.344755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4035e-dc59-4d56-9478-84d0c96f4123 None admin] PATH_INFO: `/v3/projects/c5c9a952dddd450591b47adee04135d0/users/0a5e0b53aafc4bf3a23a7882ed12a89c/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:57:58.346659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4035e-dc59-4d56-9478-84d0c96f4123 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9a952dddd450591b47adee04135d0, user_id=0a5e0b53aafc4bf3a23a7882ed12a89c, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:57:58.348079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4035e-dc59-4d56-9478-84d0c96f4123 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:57:58.360453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 639/1273] 10.222.0.13 () {58 vars in 1439 bytes} [Mon Jun 20 05:57:58 2022] PUT /identity/v3/projects/c5c9a952dddd450591b47adee04135d0/users/0a5e0b53aafc4bf3a23a7882ed12a89c/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 05:58:00.347670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121dbc-9e7e-4b09-a643-9763407960f7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.348185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121dbc-9e7e-4b09-a643-9763407960f7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.348277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121dbc-9e7e-4b09-a643-9763407960f7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.349628 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 635/1274] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:00.354826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d389a-6e56-443c-a6bf-e7ebe125b6c9 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.355260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d389a-6e56-443c-a6bf-e7ebe125b6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.355385 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d389a-6e56-443c-a6bf-e7ebe125b6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.371617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-540d389a-6e56-443c-a6bf-e7ebe125b6c9 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:00.372827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-540d389a-6e56-443c-a6bf-e7ebe125b6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:00.437252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 640/1275] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:00.460506 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd121dbc-9e7e-4b09-a643-9763407960f7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.555904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd121dbc-9e7e-4b09-a643-9763407960f7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.572721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.589791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df43604-09ca-4f51-a78c-991451288834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.590565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df43604-09ca-4f51-a78c-991451288834 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.590846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df43604-09ca-4f51-a78c-991451288834 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.591120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df43604-09ca-4f51-a78c-991451288834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.600818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df43604-09ca-4f51-a78c-991451288834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-7df43604-09ca-4f51-a78c-991451288834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 05:58:00.608556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:00.609643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:00.615173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 636/1276] 10.222.0.13 () {56 vars in 1096 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:00.617286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d389a-6e56-443c-a6bf-e7ebe125b6c9 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.695381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:00.715557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d389a-6e56-443c-a6bf-e7ebe125b6c9 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.747262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8ea53-a4d0-4c3a-8f5b-0dad6e206730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.747915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8ea53-a4d0-4c3a-8f5b-0dad6e206730 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.748197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8ea53-a4d0-4c3a-8f5b-0dad6e206730 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.748507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8ea53-a4d0-4c3a-8f5b-0dad6e206730 None admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.749760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8ea53-a4d0-4c3a-8f5b-0dad6e206730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:00.750063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8ea53-a4d0-4c3a-8f5b-0dad6e206730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.751422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8ea53-a4d0-4c3a-8f5b-0dad6e206730 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.759353 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 641/1277] 10.222.0.13 () {56 vars in 1099 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:00.765565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df43604-09ca-4f51-a78c-991451288834 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:00.861520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df43604-09ca-4f51-a78c-991451288834 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:00.893579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b7dd3-ae79-4c20-a227-fe71de0b22d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:00.894352 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7dd3-ae79-4c20-a227-fe71de0b22d5 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:00.894634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7dd3-ae79-4c20-a227-fe71de0b22d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:00.894907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b7dd3-ae79-4c20-a227-fe71de0b22d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:00.906065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b7dd3-ae79-4c20-a227-fe71de0b22d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:00.907492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b7dd3-ae79-4c20-a227-fe71de0b22d5 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-686b7dd3-ae79-4c20-a227-fe71de0b22d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:00.924131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:00.925176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:00.926418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:00.926418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:00.926418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:00.926418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:00.926418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 637/1278] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:00.930851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8ea53-a4d0-4c3a-8f5b-0dad6e206730 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.026789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8ea53-a4d0-4c3a-8f5b-0dad6e206730 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.058723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9f91d-8a5e-461d-8609-9bafea95c500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.059366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9f91d-8a5e-461d-8609-9bafea95c500 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.059651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9f91d-8a5e-461d-8609-9bafea95c500 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.059935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9f91d-8a5e-461d-8609-9bafea95c500 None admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.060679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9f91d-8a5e-461d-8609-9bafea95c500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:01.060989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9f91d-8a5e-461d-8609-9bafea95c500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.062340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a9f91d-8a5e-461d-8609-9bafea95c500 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.073531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 642/1279] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:01.079328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b7dd3-ae79-4c20-a227-fe71de0b22d5 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.109029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.175455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b7dd3-ae79-4c20-a227-fe71de0b22d5 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.207600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6a632-54e9-4337-a92c-f9069de0f8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.208401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a632-54e9-4337-a92c-f9069de0f8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.208681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a632-54e9-4337-a92c-f9069de0f8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.208953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a632-54e9-4337-a92c-f9069de0f8b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.216034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6a632-54e9-4337-a92c-f9069de0f8b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.217501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6a632-54e9-4337-a92c-f9069de0f8b7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-37a6a632-54e9-4337-a92c-f9069de0f8b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 05:58:01.231156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:01.232277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:01.233696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:01.233696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:01.233696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 05:58:01.233696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 05:58:01.233696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 05:58:01.233696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 05:58:01.233696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 05:58:01.233696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 05:58:01.233696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 05:58:01.233696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:01.233696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 638/1280] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:01.237937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9f91d-8a5e-461d-8609-9bafea95c500 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.241694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.333745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9f91d-8a5e-461d-8609-9bafea95c500 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.365879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e88a78-4a5f-4c19-b7f4-15ef36fca5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.366530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e88a78-4a5f-4c19-b7f4-15ef36fca5cc None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.366809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e88a78-4a5f-4c19-b7f4-15ef36fca5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.367082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e88a78-4a5f-4c19-b7f4-15ef36fca5cc None admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.367907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e88a78-4a5f-4c19-b7f4-15ef36fca5cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:01.368214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e88a78-4a5f-4c19-b7f4-15ef36fca5cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.369672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e88a78-4a5f-4c19-b7f4-15ef36fca5cc None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.387037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 643/1281] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:01.393190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6a632-54e9-4337-a92c-f9069de0f8b7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.481361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.490914 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6a632-54e9-4337-a92c-f9069de0f8b7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.522949 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278b5fd-8af3-4a1e-be58-66a08b433ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.523835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b5fd-8af3-4a1e-be58-66a08b433ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.524119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b5fd-8af3-4a1e-be58-66a08b433ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.524423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b5fd-8af3-4a1e-be58-66a08b433ae7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.588240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278b5fd-8af3-4a1e-be58-66a08b433ae7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.589695 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278b5fd-8af3-4a1e-be58-66a08b433ae7 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.673584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.683604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 639/1282] 10.222.0.13 () {58 vars in 1282 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 05:58:01.689846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e88a78-4a5f-4c19-b7f4-15ef36fca5cc None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.750594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:01.786855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e88a78-4a5f-4c19-b7f4-15ef36fca5cc None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.819508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd1161-4538-49cc-b084-240fdaeb9080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.820287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1161-4538-49cc-b084-240fdaeb9080 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.820594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1161-4538-49cc-b084-240fdaeb9080 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.820867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1161-4538-49cc-b084-240fdaeb9080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.830392 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd1161-4538-49cc-b084-240fdaeb9080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.831817 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd1161-4538-49cc-b084-240fdaeb9080 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-45bd1161-4538-49cc-b084-240fdaeb9080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 05:58:01.848936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:01.849997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:01.851286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 05:58:01.851286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 05:58:01.851286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 05:58:01.851286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:58:01.851286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 644/1283] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:01.855670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278b5fd-8af3-4a1e-be58-66a08b433ae7 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:01.951741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278b5fd-8af3-4a1e-be58-66a08b433ae7 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:01.984097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590dd0e-bf19-44b2-a9d1-b9572af6b4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:01.984768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590dd0e-bf19-44b2-a9d1-b9572af6b4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:01.985053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590dd0e-bf19-44b2-a9d1-b9572af6b4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:01.985332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590dd0e-bf19-44b2-a9d1-b9572af6b4d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:01.986050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590dd0e-bf19-44b2-a9d1-b9572af6b4d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:01.986359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590dd0e-bf19-44b2-a9d1-b9572af6b4d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:01.987720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590dd0e-bf19-44b2-a9d1-b9572af6b4d0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:01.999163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 640/1284] 10.222.0.13 () {56 vars in 1109 bytes} [Mon Jun 20 05:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:02.004846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd1161-4538-49cc-b084-240fdaeb9080 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.108295 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd1161-4538-49cc-b084-240fdaeb9080 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.121725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.143104 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06a1af-cf43-46af-baab-d1470fc6cfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.143956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06a1af-cf43-46af-baab-d1470fc6cfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.144294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06a1af-cf43-46af-baab-d1470fc6cfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.144649 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06a1af-cf43-46af-baab-d1470fc6cfe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.151773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06a1af-cf43-46af-baab-d1470fc6cfe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.153236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06a1af-cf43-46af-baab-d1470fc6cfe2 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application [None req-df06a1af-cf43-46af-baab-d1470fc6cfe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 05:58:02.167151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:02.168187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:02.169184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 05:58:02.169184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 05:58:02.169184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 05:58:02.169184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 05:58:02.169184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 05:58:02.169184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 05:58:02.169184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 05:58:02.169184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: ERROR keystone.server.flask.application Jun 20 05:58:02.169184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 645/1285] 10.222.0.13 () {56 vars in 1111 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:02.174597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590dd0e-bf19-44b2-a9d1-b9572af6b4d0 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.222927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:02.271962 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590dd0e-bf19-44b2-a9d1-b9572af6b4d0 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.304484 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eabdd-db15-4b8e-a3a2-94d45cf18918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.305185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eabdd-db15-4b8e-a3a2-94d45cf18918 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.305526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eabdd-db15-4b8e-a3a2-94d45cf18918 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.305804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eabdd-db15-4b8e-a3a2-94d45cf18918 None admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.306739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07eabdd-db15-4b8e-a3a2-94d45cf18918 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:02.307117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07eabdd-db15-4b8e-a3a2-94d45cf18918 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.308848 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07eabdd-db15-4b8e-a3a2-94d45cf18918 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.321166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 641/1286] 10.222.0.13 () {56 vars in 1148 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:02.327399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06a1af-cf43-46af-baab-d1470fc6cfe2 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:02.424551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06a1af-cf43-46af-baab-d1470fc6cfe2 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:02.464508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc4661-b62d-4177-8590-d3e7d2012c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:02.465154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc4661-b62d-4177-8590-d3e7d2012c4d None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:02.465435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc4661-b62d-4177-8590-d3e7d2012c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:02.465705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc4661-b62d-4177-8590-d3e7d2012c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:02.466527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc4661-b62d-4177-8590-d3e7d2012c4d None admin] RBAC: Adding query filter params (role.id=6c8f329fa3da4385b8d232e2613aa1e7, scope.project.id=c5c9a952dddd450591b47adee04135d0, user.id=0a5e0b53aafc4bf3a23a7882ed12a89c) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:02.466839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc4661-b62d-4177-8590-d3e7d2012c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:02.468291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddc4661-b62d-4177-8590-d3e7d2012c4d None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:02.473936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 646/1287] 10.222.0.13 () {56 vars in 1374 bytes} [Mon Jun 20 05:58:02 2022] GET /identity/v3/role_assignments?user.id=0a5e0b53aafc4bf3a23a7882ed12a89c&scope.project.id=c5c9a952dddd450591b47adee04135d0&role.id=6c8f329fa3da4385b8d232e2613aa1e7 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:04.491628 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845df12e-fcd7-4800-ae69-2f4c43bbc1e0 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.492177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845df12e-fcd7-4800-ae69-2f4c43bbc1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.492177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845df12e-fcd7-4800-ae69-2f4c43bbc1e0 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.493512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 642/1288] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:04.499018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebd1d0-9dc8-44ef-81e8-b10c9b03a6d0 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.499436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebd1d0-9dc8-44ef-81e8-b10c9b03a6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.499584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebd1d0-9dc8-44ef-81e8-b10c9b03a6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.515881 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a8ebd1d0-9dc8-44ef-81e8-b10c9b03a6d0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:04.517095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a8ebd1d0-9dc8-44ef-81e8-b10c9b03a6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:04.546738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:04.582968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 647/1289] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:04.605196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845df12e-fcd7-4800-ae69-2f4c43bbc1e0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:04.702303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845df12e-fcd7-4800-ae69-2f4c43bbc1e0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:04.712894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:04.736796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a43f5-53eb-4790-b60e-561e073bd6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:04.737581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a43f5-53eb-4790-b60e-561e073bd6ac None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.737864 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a43f5-53eb-4790-b60e-561e073bd6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.738140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a43f5-53eb-4790-b60e-561e073bd6ac None admin] PATH_INFO: `/v3/services/placement` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.738784 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a43f5-53eb-4790-b60e-561e073bd6ac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:04.740152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a43f5-53eb-4790-b60e-561e073bd6ac None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-b85a43f5-53eb-4790-b60e-561e073bd6ac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:04.751738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:04.753023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:04.754157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 643/1290] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 20 05:58:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:04.758734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebd1d0-9dc8-44ef-81e8-b10c9b03a6d0 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:04.859377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebd1d0-9dc8-44ef-81e8-b10c9b03a6d0 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:04.891478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f702b1e-f972-4c90-bd17-eb24523ebabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:04.892126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f702b1e-f972-4c90-bd17-eb24523ebabd None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:04.892437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f702b1e-f972-4c90-bd17-eb24523ebabd None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:04.892713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f702b1e-f972-4c90-bd17-eb24523ebabd None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:04.893413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f702b1e-f972-4c90-bd17-eb24523ebabd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:04.893717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f702b1e-f972-4c90-bd17-eb24523ebabd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:04.895078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f702b1e-f972-4c90-bd17-eb24523ebabd None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:04.900002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 648/1291] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Jun 20 05:58:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:04.906702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a43f5-53eb-4790-b60e-561e073bd6ac None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:05.006813 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a43f5-53eb-4790-b60e-561e073bd6ac None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:05.045179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8288cf-c1b5-43d9-82a4-20c7c15a6245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:05.045869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8288cf-c1b5-43d9-82a4-20c7c15a6245 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:05.046266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8288cf-c1b5-43d9-82a4-20c7c15a6245 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:05.046726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8288cf-c1b5-43d9-82a4-20c7c15a6245 None admin] PATH_INFO: `/v3/services` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:05.048062 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8288cf-c1b5-43d9-82a4-20c7c15a6245 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:05.048725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8288cf-c1b5-43d9-82a4-20c7c15a6245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:05.050289 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8288cf-c1b5-43d9-82a4-20c7c15a6245 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:05.055821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 644/1292] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Jun 20 05:58:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:07.088359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d299-a6ed-417d-98e6-aaa1f96716e1 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.088930 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d299-a6ed-417d-98e6-aaa1f96716e1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.088930 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47d299-a6ed-417d-98e6-aaa1f96716e1 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.090261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 649/1293] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:07.095863 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6ad3c-816c-4c29-b3dc-bdf8465f472b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.096290 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6ad3c-816c-4c29-b3dc-bdf8465f472b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.096444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6ad3c-816c-4c29-b3dc-bdf8465f472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.113575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-dcf6ad3c-816c-4c29-b3dc-bdf8465f472b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:07.114760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dcf6ad3c-816c-4c29-b3dc-bdf8465f472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:07.142698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.179647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 645/1294] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:07.211321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47d299-a6ed-417d-98e6-aaa1f96716e1 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:07.241958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:07.311847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47d299-a6ed-417d-98e6-aaa1f96716e1 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:07.343663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5b643-a9b3-4f01-88b2-1620dc331aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:07.344254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5b643-a9b3-4f01-88b2-1620dc331aef None admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:07.344565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5b643-a9b3-4f01-88b2-1620dc331aef None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:07.344840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5b643-a9b3-4f01-88b2-1620dc331aef None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:07.345574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5b643-a9b3-4f01-88b2-1620dc331aef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:07.346939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5b643-a9b3-4f01-88b2-1620dc331aef None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:07.360050 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 650/1295] 10.222.0.13 () {60 vars in 1141 bytes} [Mon Jun 20 05:58:07 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 05:58:09.658762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1fb5c-6c4a-45f6-8e2f-8defd8f26154 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.659321 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1fb5c-6c4a-45f6-8e2f-8defd8f26154 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.659321 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1fb5c-6c4a-45f6-8e2f-8defd8f26154 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.660899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 646/1296] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:09.666376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097f56-fd3a-47e4-b89e-16db2fb141ce None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.666798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097f56-fd3a-47e4-b89e-16db2fb141ce None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.666937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097f56-fd3a-47e4-b89e-16db2fb141ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.683655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-f6097f56-fd3a-47e4-b89e-16db2fb141ce None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:09.684876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f6097f56-fd3a-47e4-b89e-16db2fb141ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:09.754732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 651/1297] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:09.777775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1fb5c-6c4a-45f6-8e2f-8defd8f26154 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:09.878022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1fb5c-6c4a-45f6-8e2f-8defd8f26154 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:09.914631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e4037-5b42-4f3c-92a9-f045380a1dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:09.915346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e4037-5b42-4f3c-92a9-f045380a1dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:09.915630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e4037-5b42-4f3c-92a9-f045380a1dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:09.915908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e4037-5b42-4f3c-92a9-f045380a1dd0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:09.916595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e4037-5b42-4f3c-92a9-f045380a1dd0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:09.917978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e4037-5b42-4f3c-92a9-f045380a1dd0 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-070e4037-5b42-4f3c-92a9-f045380a1dd0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:09.930331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:09.931516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:09.932616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 647/1298] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 20 05:58:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:09.937681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6097f56-fd3a-47e4-b89e-16db2fb141ce None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:09.955382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:10.046663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6097f56-fd3a-47e4-b89e-16db2fb141ce None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:10.079735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98b91e-77b6-4672-9cb4-331682cb95a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.080421 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b91e-77b6-4672-9cb4-331682cb95a4 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.080718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b91e-77b6-4672-9cb4-331682cb95a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.080997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b91e-77b6-4672-9cb4-331682cb95a4 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.081708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98b91e-77b6-4672-9cb4-331682cb95a4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:10.082020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98b91e-77b6-4672-9cb4-331682cb95a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:10.083396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98b91e-77b6-4672-9cb4-331682cb95a4 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:10.088416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 652/1299] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Jun 20 05:58:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:10.094817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e4037-5b42-4f3c-92a9-f045380a1dd0 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.125692 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:10.192518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e4037-5b42-4f3c-92a9-f045380a1dd0 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:10.225178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a51490-269d-4336-8ff4-6037ea16dfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.225826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a51490-269d-4336-8ff4-6037ea16dfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.226112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a51490-269d-4336-8ff4-6037ea16dfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.226389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a51490-269d-4336-8ff4-6037ea16dfc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.227176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a51490-269d-4336-8ff4-6037ea16dfc2 None admin] RBAC: Adding query filter params (interface=public, service_id=48f2d7ddf2c34c2bb7fccd7ef24e0779, region_id=RegionOne) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:10.227491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a51490-269d-4336-8ff4-6037ea16dfc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:10.228886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a51490-269d-4336-8ff4-6037ea16dfc2 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:10.234467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 648/1300] 10.222.0.13 () {56 vars in 1251 bytes} [Mon Jun 20 05:58:10 2022] GET /identity/v3/endpoints?service_id=48f2d7ddf2c34c2bb7fccd7ef24e0779&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:10.239948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98b91e-77b6-4672-9cb4-331682cb95a4 None admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:10.318619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:10.336505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98b91e-77b6-4672-9cb4-331682cb95a4 None admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:10.369183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300df7c-47e2-4897-8150-a9374a9c7ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:10.369836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300df7c-47e2-4897-8150-a9374a9c7ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:10.370123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300df7c-47e2-4897-8150-a9374a9c7ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:10.370400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300df7c-47e2-4897-8150-a9374a9c7ab7 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:10.371078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300df7c-47e2-4897-8150-a9374a9c7ab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:10.372467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300df7c-47e2-4897-8150-a9374a9c7ab7 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:10.379050 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 653/1301] 10.222.0.13 () {56 vars in 1087 bytes} [Mon Jun 20 05:58:10 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 05:58:12.383686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f531b4-5aa9-40d9-b13f-a196c0ba9e6a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.384236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f531b4-5aa9-40d9-b13f-a196c0ba9e6a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.384236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f531b4-5aa9-40d9-b13f-a196c0ba9e6a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.385641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 649/1302] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:58:12.391176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f195738-9cd1-40ac-99b6-3e195402d7bd None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.391603 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f195738-9cd1-40ac-99b6-3e195402d7bd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.391738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f195738-9cd1-40ac-99b6-3e195402d7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.408370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-3f195738-9cd1-40ac-99b6-3e195402d7bd None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:58:12.409563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3f195738-9cd1-40ac-99b6-3e195402d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:58:12.475790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 654/1303] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:58:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 05:58:12.499218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f531b4-5aa9-40d9-b13f-a196c0ba9e6a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.590902 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:12.597872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f531b4-5aa9-40d9-b13f-a196c0ba9e6a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.629990 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fca70-82f2-45a9-9550-88630c014e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.630794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fca70-82f2-45a9-9550-88630c014e39 None admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.631074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fca70-82f2-45a9-9550-88630c014e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.631346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fca70-82f2-45a9-9550-88630c014e39 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.631986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fca70-82f2-45a9-9550-88630c014e39 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.633371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fca70-82f2-45a9-9550-88630c014e39 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application [None req-5d2fca70-82f2-45a9-9550-88630c014e39 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 05:58:12.644793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 05:58:12.645994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application with Lock( Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self._enter() Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application return self.creator() Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application created_value = creator( Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: ERROR keystone.server.flask.application Jun 20 05:58:12.646904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 650/1304] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 05:58:12.652010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f195738-9cd1-40ac-99b6-3e195402d7bd None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.725490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:12.749299 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f195738-9cd1-40ac-99b6-3e195402d7bd None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.781976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bdd6f-de4d-42c3-93ee-e325d5a8b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.782627 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bdd6f-de4d-42c3-93ee-e325d5a8b909 None admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.782911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bdd6f-de4d-42c3-93ee-e325d5a8b909 None admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.783187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bdd6f-de4d-42c3-93ee-e325d5a8b909 None admin] PATH_INFO: `/v3/services` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.783892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bdd6f-de4d-42c3-93ee-e325d5a8b909 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 05:58:12.784201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bdd6f-de4d-42c3-93ee-e325d5a8b909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.785664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bdd6f-de4d-42c3-93ee-e325d5a8b909 None admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.792664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 655/1305] 10.222.0.13 () {56 vars in 1116 bytes} [Mon Jun 20 05:58:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 05:58:12.798932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fca70-82f2-45a9-9550-88630c014e39 None admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:58:12.905016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fca70-82f2-45a9-9550-88630c014e39 None admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:58:12.939998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776617-5ea4-4802-9106-86fcbe4c7324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:58:12.940669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776617-5ea4-4802-9106-86fcbe4c7324 None admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:58:12.940957 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776617-5ea4-4802-9106-86fcbe4c7324 None admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:58:12.941236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776617-5ea4-4802-9106-86fcbe4c7324 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:58:12.941987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2776617-5ea4-4802-9106-86fcbe4c7324 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:58:12.943391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2776617-5ea4-4802-9106-86fcbe4c7324 None admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:58:12.963409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 651/1306] 10.222.0.13 () {60 vars in 1144 bytes} [Mon Jun 20 05:58:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 05:58:22.788543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=30 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:58:22.957306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:15.213581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3800753-208b-4fce-8f1b-d25a8ce913fe None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.214158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3800753-208b-4fce-8f1b-d25a8ce913fe None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.214400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3800753-208b-4fce-8f1b-d25a8ce913fe None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.221252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c8d40-7dd9-46b7-a3b7-4600ce6da588 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.221723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c8d40-7dd9-46b7-a3b7-4600ce6da588 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.222036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c8d40-7dd9-46b7-a3b7-4600ce6da588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.224281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 656/1307] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:15.308676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-dd6c8d40-7dd9-46b7-a3b7-4600ce6da588 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:15.310059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dd6c8d40-7dd9-46b7-a3b7-4600ce6da588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:15.465669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 652/1308] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 05:59:15.509814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17ce20-e4e5-4b47-abcf-14e5dedad62c None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.509814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17ce20-e4e5-4b47-abcf-14e5dedad62c None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.509814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17ce20-e4e5-4b47-abcf-14e5dedad62c None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.509814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 657/1309] 10.222.0.13 () {54 vars in 964 bytes} [Mon Jun 20 05:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:15.514262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec25736-229c-49a1-95d1-88bc4cf79780 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.515476 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec25736-229c-49a1-95d1-88bc4cf79780 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.515476 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec25736-229c-49a1-95d1-88bc4cf79780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.620141 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cec25736-229c-49a1-95d1-88bc4cf79780 None None] MFA Rules not processed for user `70b46194590c47c08c8d9d98904a2d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:15.621929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cec25736-229c-49a1-95d1-88bc4cf79780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:15.644993 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:15.716766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17ce20-e4e5-4b47-abcf-14e5dedad62c None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:15.718449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ce17ce20-e4e5-4b47-abcf-14e5dedad62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:15.722628 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 653/1310] 10.222.0.13 () {58 vars in 1061 bytes} [Mon Jun 20 05:59:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 05:59:15.838549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17ce20-e4e5-4b47-abcf-14e5dedad62c None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:15.919456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f870c-a264-4e4a-82a3-e227936999f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:15.920744 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f870c-a264-4e4a-82a3-e227936999f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:15.921272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f870c-a264-4e4a-82a3-e227936999f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:15.921777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f870c-a264-4e4a-82a3-e227936999f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:15.923899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f94f870c-a264-4e4a-82a3-e227936999f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:15.984396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:16.046648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f870c-a264-4e4a-82a3-e227936999f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:16.048296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f870c-a264-4e4a-82a3-e227936999f4 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:16.068902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 658/1311] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 05:59:18.448229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0530ccb-67b2-46cb-b671-fde1c0c0ac68 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.448804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0530ccb-67b2-46cb-b671-fde1c0c0ac68 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.448897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0530ccb-67b2-46cb-b671-fde1c0c0ac68 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.450265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 654/1312] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:18.455535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7e3d-ed12-450f-8e5b-fc69236ec630 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.455955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7e3d-ed12-450f-8e5b-fc69236ec630 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.456102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc7e3d-ed12-450f-8e5b-fc69236ec630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.526333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-cdbc7e3d-ed12-450f-8e5b-fc69236ec630 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:18.528189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-cdbc7e3d-ed12-450f-8e5b-fc69236ec630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:18.625736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 659/1313] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:18.681286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3a674-8018-4e1f-9bcb-3406bdbe35e4 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.681578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3a674-8018-4e1f-9bcb-3406bdbe35e4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.681862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3a674-8018-4e1f-9bcb-3406bdbe35e4 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.683260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 655/1314] 10.222.0.13 () {54 vars in 964 bytes} [Mon Jun 20 05:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:18.689692 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3a92a-bb1f-448c-a67e-93abb10d9cbc None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:18.690070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3a92a-bb1f-448c-a67e-93abb10d9cbc None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:18.690422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3a92a-bb1f-448c-a67e-93abb10d9cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:18.701296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:18.772636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-7bf3a92a-bb1f-448c-a67e-93abb10d9cbc None None] MFA Rules not processed for user `70b46194590c47c08c8d9d98904a2d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:18.773860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7bf3a92a-bb1f-448c-a67e-93abb10d9cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:18.851636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 660/1315] 10.222.0.13 () {58 vars in 1061 bytes} [Mon Jun 20 05:59:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:18.860534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3a674-8018-4e1f-9bcb-3406bdbe35e4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:18.862049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9de3a674-8018-4e1f-9bcb-3406bdbe35e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:18.968739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3a674-8018-4e1f-9bcb-3406bdbe35e4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:19.041483 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:19.044473 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8adcba-e75b-4568-b099-ee09920d1b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:19.045341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8adcba-e75b-4568-b099-ee09920d1b32 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:19.045828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8adcba-e75b-4568-b099-ee09920d1b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:19.046185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8adcba-e75b-4568-b099-ee09920d1b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:19.048151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fc8adcba-e75b-4568-b099-ee09920d1b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:19.155427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8adcba-e75b-4568-b099-ee09920d1b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:19.156915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8adcba-e75b-4568-b099-ee09920d1b32 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:19.175900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 656/1316] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 05:59:21.708913 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705431cf-bb64-491c-bfbd-4cbbd4dcb7cd None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.709450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705431cf-bb64-491c-bfbd-4cbbd4dcb7cd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.709450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705431cf-bb64-491c-bfbd-4cbbd4dcb7cd None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.710819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 661/1317] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:21.716376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37e266-c098-4d68-b5d8-81715171658b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:21.716782 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37e266-c098-4d68-b5d8-81715171658b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:21.716935 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37e266-c098-4d68-b5d8-81715171658b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:21.780950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8b37e266-c098-4d68-b5d8-81715171658b None None] MFA Rules not processed for user `73bcdb8c740d442ba5c3dfc9d8df69e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:21.782163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8b37e266-c098-4d68-b5d8-81715171658b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:21.833714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:21.876891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 657/1318] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:21.916548 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705431cf-bb64-491c-bfbd-4cbbd4dcb7cd None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:21.918133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-705431cf-bb64-491c-bfbd-4cbbd4dcb7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:22.018156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705431cf-bb64-491c-bfbd-4cbbd4dcb7cd None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:22.020852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:22.089994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027d4bc-3202-4600-8d79-5fe554657d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:22.090625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027d4bc-3202-4600-8d79-5fe554657d81 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:22.090911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027d4bc-3202-4600-8d79-5fe554657d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:22.091183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027d4bc-3202-4600-8d79-5fe554657d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:22.092822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4027d4bc-3202-4600-8d79-5fe554657d81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:22.195923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027d4bc-3202-4600-8d79-5fe554657d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:22.197378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027d4bc-3202-4600-8d79-5fe554657d81 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:22.215729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 662/1319] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 05:59:24.773129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692ec89-1e8b-4028-aa9a-05c7bc2b0406 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.773668 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692ec89-1e8b-4028-aa9a-05c7bc2b0406 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.773668 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692ec89-1e8b-4028-aa9a-05c7bc2b0406 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.775071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 658/1320] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:24.780446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00560fe-78d7-4089-81f2-82b8990fc31b None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:24.780847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00560fe-78d7-4089-81f2-82b8990fc31b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:24.781019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00560fe-78d7-4089-81f2-82b8990fc31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:24.819980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:24.846381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a00560fe-78d7-4089-81f2-82b8990fc31b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:24.847570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a00560fe-78d7-4089-81f2-82b8990fc31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:24.941931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 663/1321] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:24.980238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692ec89-1e8b-4028-aa9a-05c7bc2b0406 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:24.981876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1692ec89-1e8b-4028-aa9a-05c7bc2b0406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:25.084329 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692ec89-1e8b-4028-aa9a-05c7bc2b0406 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:25.155084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bc1cf-b4ea-476c-ae4d-938c3c44992d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:25.155723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc1cf-b4ea-476c-ae4d-938c3c44992d service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:25.156004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc1cf-b4ea-476c-ae4d-938c3c44992d service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:25.156278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bc1cf-b4ea-476c-ae4d-938c3c44992d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:25.157922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-545bc1cf-b4ea-476c-ae4d-938c3c44992d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:25.165139 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:25.264486 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bc1cf-b4ea-476c-ae4d-938c3c44992d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:25.265923 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bc1cf-b4ea-476c-ae4d-938c3c44992d service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:25.283847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 659/1322] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 05:59:27.945844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a52794-cf94-48ec-a88d-155db76d6d80 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.946386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a52794-cf94-48ec-a88d-155db76d6d80 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.946386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a52794-cf94-48ec-a88d-155db76d6d80 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:27.947756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 664/1323] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:27.953402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1897045-11b3-4331-baff-514825cc3378 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:27.953812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1897045-11b3-4331-baff-514825cc3378 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:27.953961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1897045-11b3-4331-baff-514825cc3378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.021144 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a1897045-11b3-4331-baff-514825cc3378 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:28.022614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a1897045-11b3-4331-baff-514825cc3378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:28.082516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:28.127089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 660/1324] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:28.164290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a52794-cf94-48ec-a88d-155db76d6d80 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:28.165918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d5a52794-cf94-48ec-a88d-155db76d6d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:28.276144 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a52794-cf94-48ec-a88d-155db76d6d80 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:28.288847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:28.352510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392bfb3-efdc-4dcb-8097-4fe89654db4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:28.353159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392bfb3-efdc-4dcb-8097-4fe89654db4c service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:28.353444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392bfb3-efdc-4dcb-8097-4fe89654db4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:28.353721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392bfb3-efdc-4dcb-8097-4fe89654db4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:28.355425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7392bfb3-efdc-4dcb-8097-4fe89654db4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:28.465248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392bfb3-efdc-4dcb-8097-4fe89654db4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:28.466685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392bfb3-efdc-4dcb-8097-4fe89654db4c service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:28.484780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 665/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 05:59:30.566016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad6f5d-b8a4-4120-88f3-af81d28d8c30 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:30.566521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad6f5d-b8a4-4120-88f3-af81d28d8c30 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:30.566521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad6f5d-b8a4-4120-88f3-af81d28d8c30 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:30.567995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 661/1326] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:30.573151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b87601-ef5a-473c-a2c7-4b1513d16749 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:30.573556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b87601-ef5a-473c-a2c7-4b1513d16749 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:30.573821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b87601-ef5a-473c-a2c7-4b1513d16749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:30.620517 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:30.638274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c7b87601-ef5a-473c-a2c7-4b1513d16749 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:30.639464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c7b87601-ef5a-473c-a2c7-4b1513d16749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:30.737472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 666/1327] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:30.773043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad6f5d-b8a4-4120-88f3-af81d28d8c30 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:30.774579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-70ad6f5d-b8a4-4120-88f3-af81d28d8c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:30.879290 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad6f5d-b8a4-4120-88f3-af81d28d8c30 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:30.962198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31363e5-2e65-4b38-93aa-9bc572739109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:30.962851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31363e5-2e65-4b38-93aa-9bc572739109 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:30.963138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31363e5-2e65-4b38-93aa-9bc572739109 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:30.963477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31363e5-2e65-4b38-93aa-9bc572739109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:30.965730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b31363e5-2e65-4b38-93aa-9bc572739109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:30.983178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:31.077662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31363e5-2e65-4b38-93aa-9bc572739109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:31.079108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31363e5-2e65-4b38-93aa-9bc572739109 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:31.097795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 662/1328] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 05:59:33.189168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118e9b-0574-4225-904f-c77c88c08f36 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.189694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118e9b-0574-4225-904f-c77c88c08f36 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.189694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118e9b-0574-4225-904f-c77c88c08f36 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.191083 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 667/1329] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:33.196528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d58622-5336-484a-bcbe-1f36412c3e83 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.196970 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d58622-5336-484a-bcbe-1f36412c3e83 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.197254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d58622-5336-484a-bcbe-1f36412c3e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.267254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-98d58622-5336-484a-bcbe-1f36412c3e83 None None] MFA Rules not processed for user `73bcdb8c740d442ba5c3dfc9d8df69e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:33.268423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-98d58622-5336-484a-bcbe-1f36412c3e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:33.335092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:33.371548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 663/1330] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:33.408746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118e9b-0574-4225-904f-c77c88c08f36 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:33.410273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-97118e9b-0574-4225-904f-c77c88c08f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:33.509861 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118e9b-0574-4225-904f-c77c88c08f36 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:33.530087 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:33.585510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58b72b-7044-413d-bbdd-2a8b5ef2c400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:33.586161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b72b-7044-413d-bbdd-2a8b5ef2c400 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:33.586446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b72b-7044-413d-bbdd-2a8b5ef2c400 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:33.586721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b72b-7044-413d-bbdd-2a8b5ef2c400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:33.588910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-dd58b72b-7044-413d-bbdd-2a8b5ef2c400 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:33.694724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58b72b-7044-413d-bbdd-2a8b5ef2c400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:33.696166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58b72b-7044-413d-bbdd-2a8b5ef2c400 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:33.724012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 668/1331] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 05:59:36.005374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff068e-94cb-4c38-b3ea-dcc4d43142c4 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:36.006017 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff068e-94cb-4c38-b3ea-dcc4d43142c4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:36.006017 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff068e-94cb-4c38-b3ea-dcc4d43142c4 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:36.007310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 664/1332] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:36.013071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6597-a20f-4633-8e54-f0a1f40c1a02 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:36.013501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6597-a20f-4633-8e54-f0a1f40c1a02 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:36.013640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f6597-a20f-4633-8e54-f0a1f40c1a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:36.076453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:36.079141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-099f6597-a20f-4633-8e54-f0a1f40c1a02 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:36.080941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-099f6597-a20f-4633-8e54-f0a1f40c1a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:36.175495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 669/1333] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:36.211485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff068e-94cb-4c38-b3ea-dcc4d43142c4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:36.213124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5fff068e-94cb-4c38-b3ea-dcc4d43142c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:36.315040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff068e-94cb-4c38-b3ea-dcc4d43142c4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:36.387837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6aae7-7bac-4235-98a5-8d2a95678f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:36.388504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6aae7-7bac-4235-98a5-8d2a95678f24 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:36.388792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6aae7-7bac-4235-98a5-8d2a95678f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:36.389066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6aae7-7bac-4235-98a5-8d2a95678f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:36.390741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-05a6aae7-7bac-4235-98a5-8d2a95678f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:36.417385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:36.504814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6aae7-7bac-4235-98a5-8d2a95678f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:36.506280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6aae7-7bac-4235-98a5-8d2a95678f24 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:36.531533 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 665/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 05:59:38.595578 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e09dd-5adc-4eb5-b2a7-a4f38dbaba29 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.596096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e09dd-5adc-4eb5-b2a7-a4f38dbaba29 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.596096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e09dd-5adc-4eb5-b2a7-a4f38dbaba29 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.597466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 670/1335] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:38.602510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ecfc-6e35-4c5f-a21a-0dcb97373027 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.602900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ecfc-6e35-4c5f-a21a-0dcb97373027 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.603079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94ecfc-6e35-4c5f-a21a-0dcb97373027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.666025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4e94ecfc-6e35-4c5f-a21a-0dcb97373027 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:38.667755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4e94ecfc-6e35-4c5f-a21a-0dcb97373027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:38.739346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:38.762230 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 666/1336] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:38.801404 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e09dd-5adc-4eb5-b2a7-a4f38dbaba29 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:38.802921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c42e09dd-5adc-4eb5-b2a7-a4f38dbaba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:38.904845 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e09dd-5adc-4eb5-b2a7-a4f38dbaba29 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:38.932479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:38.975894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9662259-53f2-4e53-bd5b-5a3405be862b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:38.976558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662259-53f2-4e53-bd5b-5a3405be862b service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:38.976845 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662259-53f2-4e53-bd5b-5a3405be862b service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:38.977121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9662259-53f2-4e53-bd5b-5a3405be862b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:38.978775 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f9662259-53f2-4e53-bd5b-5a3405be862b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:39.086011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9662259-53f2-4e53-bd5b-5a3405be862b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:39.087449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9662259-53f2-4e53-bd5b-5a3405be862b service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:39.105509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 671/1337] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 05:59:41.440530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107281e3-6364-4e94-b102-f092734d6d4b None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:41.441068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107281e3-6364-4e94-b102-f092734d6d4b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:41.441068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107281e3-6364-4e94-b102-f092734d6d4b None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:41.442448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 667/1338] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:41.447579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cbd41-f3ca-4c73-a7c5-f645cfe07859 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:41.447963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cbd41-f3ca-4c73-a7c5-f645cfe07859 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:41.448139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cbd41-f3ca-4c73-a7c5-f645cfe07859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:41.510974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-787cbd41-f3ca-4c73-a7c5-f645cfe07859 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:41.512165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-787cbd41-f3ca-4c73-a7c5-f645cfe07859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:41.520403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:41.607071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 672/1339] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:41.642698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107281e3-6364-4e94-b102-f092734d6d4b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:41.644204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-107281e3-6364-4e94-b102-f092734d6d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:41.744872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107281e3-6364-4e94-b102-f092734d6d4b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:41.815839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374adcd3-8101-4db5-b46b-86356340ea08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:41.816596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374adcd3-8101-4db5-b46b-86356340ea08 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:41.816879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374adcd3-8101-4db5-b46b-86356340ea08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:41.817152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374adcd3-8101-4db5-b46b-86356340ea08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:41.818769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-374adcd3-8101-4db5-b46b-86356340ea08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:41.854169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:41.925224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374adcd3-8101-4db5-b46b-86356340ea08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:41.926651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374adcd3-8101-4db5-b46b-86356340ea08 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:41.944659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 668/1340] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 05:59:45.853154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ff07c-7e5f-4fe8-8f84-6dd7e0e2d9bd None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.854244 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ff07c-7e5f-4fe8-8f84-6dd7e0e2d9bd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.854381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ff07c-7e5f-4fe8-8f84-6dd7e0e2d9bd None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.855862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 673/1341] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:45.861093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e364a7-317a-4278-a9c8-4835b24d7d5c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:45.861514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e364a7-317a-4278-a9c8-4835b24d7d5c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:45.861655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e364a7-317a-4278-a9c8-4835b24d7d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:45.932956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-71e364a7-317a-4278-a9c8-4835b24d7d5c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:45.934089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-71e364a7-317a-4278-a9c8-4835b24d7d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:46.028370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:46.042052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 669/1342] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:46.080863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ff07c-7e5f-4fe8-8f84-6dd7e0e2d9bd None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:46.082979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-bd5ff07c-7e5f-4fe8-8f84-6dd7e0e2d9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:46.175845 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ff07c-7e5f-4fe8-8f84-6dd7e0e2d9bd None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:46.179492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1556a-3b90-43be-b5c9-871c3f46a011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:46.180142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1556a-3b90-43be-b5c9-871c3f46a011 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:46.180456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1556a-3b90-43be-b5c9-871c3f46a011 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:46.180731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1556a-3b90-43be-b5c9-871c3f46a011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:46.190623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1556a-3b90-43be-b5c9-871c3f46a011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:46.191999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1556a-3b90-43be-b5c9-871c3f46a011 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:46.201883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 674/1343] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 05:59:48.856664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e936401-89fa-4d0c-a991-d1169290915f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.857236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e936401-89fa-4d0c-a991-d1169290915f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.857236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e936401-89fa-4d0c-a991-d1169290915f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.858587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 670/1344] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:48.863775 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a6e6c-d712-40bf-adb5-dfc078f3d286 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:48.864222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a6e6c-d712-40bf-adb5-dfc078f3d286 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:48.864436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a6e6c-d712-40bf-adb5-dfc078f3d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:48.891719 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b57a6e6c-d712-40bf-adb5-dfc078f3d286 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:48.892931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b57a6e6c-d712-40bf-adb5-dfc078f3d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:48.920291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 05:59:48.975901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 675/1345] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:49.014347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e936401-89fa-4d0c-a991-d1169290915f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:49.026181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e936401-89fa-4d0c-a991-d1169290915f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:49.029869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582be14f-4aeb-46a0-99b3-cf04b13dc65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:49.030527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be14f-4aeb-46a0-99b3-cf04b13dc65a service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:49.030807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be14f-4aeb-46a0-99b3-cf04b13dc65a service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:49.031077 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582be14f-4aeb-46a0-99b3-cf04b13dc65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:49.040916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582be14f-4aeb-46a0-99b3-cf04b13dc65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:49.042935 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582be14f-4aeb-46a0-99b3-cf04b13dc65a service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:49.052965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 671/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 05:59:53.042202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d638b-5d68-47eb-b0b1-01153df48637 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:53.042763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d638b-5d68-47eb-b0b1-01153df48637 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:53.042763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d638b-5d68-47eb-b0b1-01153df48637 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:53.044078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 676/1347] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 05:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 05:59:53.049753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f55f-39d1-4170-a36f-1f6648bd5206 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:53.050167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f55f-39d1-4170-a36f-1f6648bd5206 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:53.050364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f55f-39d1-4170-a36f-1f6648bd5206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:53.068924 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-47d8f55f-39d1-4170-a36f-1f6648bd5206 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:53.070131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-47d8f55f-39d1-4170-a36f-1f6648bd5206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:53.078571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 672/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 05:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 05:59:53.116521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d638b-5d68-47eb-b0b1-01153df48637 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 05:59:53.118398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-879d638b-5d68-47eb-b0b1-01153df48637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:53.133020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d638b-5d68-47eb-b0b1-01153df48637 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 05:59:53.137173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0ec6e-28f2-4b4f-82dc-5e42f1c9f840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 05:59:53.137791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ec6e-28f2-4b4f-82dc-5e42f1c9f840 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:53.138073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ec6e-28f2-4b4f-82dc-5e42f1c9f840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:53.138345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ec6e-28f2-4b4f-82dc-5e42f1c9f840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:53.147508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ec6e-28f2-4b4f-82dc-5e42f1c9f840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 05:59:53.148962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ec6e-28f2-4b4f-82dc-5e42f1c9f840 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 05:59:53.158377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 677/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 05:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 05:59:58.323876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60237b39-8222-4ea7-8764-74b9d1b03f9f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.324343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60237b39-8222-4ea7-8764-74b9d1b03f9f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.324714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60237b39-8222-4ea7-8764-74b9d1b03f9f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.327448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 673/1350] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 05:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 05:59:58.331637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fadc-7c2c-4273-b8e1-a7da5e6232e1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 05:59:58.332076 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fadc-7c2c-4273-b8e1-a7da5e6232e1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 05:59:58.332195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1fadc-7c2c-4273-b8e1-a7da5e6232e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 05:59:58.418482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d9e1fadc-7c2c-4273-b8e1-a7da5e6232e1 None None] MFA Rules not processed for user `0a5e0b53aafc4bf3a23a7882ed12a89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 05:59:58.419911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d9e1fadc-7c2c-4273-b8e1-a7da5e6232e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 05:59:58.557661 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 678/1351] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 05:59:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:02.856468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98314bf0-d27e-4085-832a-4f5c75a0e1bf None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.856999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98314bf0-d27e-4085-832a-4f5c75a0e1bf None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.857082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98314bf0-d27e-4085-832a-4f5c75a0e1bf None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.858402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 674/1352] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:02.863802 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcab758-6730-4325-9c26-ef83091fd5bf None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:02.864239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcab758-6730-4325-9c26-ef83091fd5bf None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:02.864416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcab758-6730-4325-9c26-ef83091fd5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:02.883139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8bcab758-6730-4325-9c26-ef83091fd5bf None None] MFA Rules not processed for user `0a5e0b53aafc4bf3a23a7882ed12a89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:02.884516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8bcab758-6730-4325-9c26-ef83091fd5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:02.893120 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 679/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:00:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:03.064413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=13 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:04.293242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17109-b2b8-459b-b330-cafcef2b9cd7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.293886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17109-b2b8-459b-b330-cafcef2b9cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.293886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17109-b2b8-459b-b330-cafcef2b9cd7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.295169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 675/1354] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:04.300044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fde1f-2e9e-4ae9-8d5c-cd2c25da3831 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:04.300455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fde1f-2e9e-4ae9-8d5c-cd2c25da3831 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:04.300782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fde1f-2e9e-4ae9-8d5c-cd2c25da3831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:04.318706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d14fde1f-2e9e-4ae9-8d5c-cd2c25da3831 None None] MFA Rules not processed for user `0a5e0b53aafc4bf3a23a7882ed12a89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:04.319995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d14fde1f-2e9e-4ae9-8d5c-cd2c25da3831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:04.329287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 680/1355] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:00:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:08.053616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21c90-4fa9-46bc-a88e-93a74297d62c None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.054155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21c90-4fa9-46bc-a88e-93a74297d62c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.054155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21c90-4fa9-46bc-a88e-93a74297d62c None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.059954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 676/1356] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:08.061477 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98cd9c-5616-4ad3-8997-fb4770612e37 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.061932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98cd9c-5616-4ad3-8997-fb4770612e37 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.062032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98cd9c-5616-4ad3-8997-fb4770612e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.083972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-2f98cd9c-5616-4ad3-8997-fb4770612e37 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:08.085235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2f98cd9c-5616-4ad3-8997-fb4770612e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:08.093128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 681/1357] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:08.148526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a008f-e4d6-4532-bbbb-c3feb4f0129a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.149034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a008f-e4d6-4532-bbbb-c3feb4f0129a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.149508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a008f-e4d6-4532-bbbb-c3feb4f0129a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.151300 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 677/1358] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jun 20 06:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:08.160802 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54194c42-f848-43c1-9121-672a900cda86 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.161342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54194c42-f848-43c1-9121-672a900cda86 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.162717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54194c42-f848-43c1-9121-672a900cda86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.208716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:08.217152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-54194c42-f848-43c1-9121-672a900cda86 None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:08.218350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-54194c42-f848-43c1-9121-672a900cda86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:08.307103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 682/1359] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jun 20 06:00:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:00:08.314880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a008f-e4d6-4532-bbbb-c3feb4f0129a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:08.329812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a008f-e4d6-4532-bbbb-c3feb4f0129a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:08.335212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49630a98-5fe3-4ece-af62-012eb18102a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:08.335845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630a98-5fe3-4ece-af62-012eb18102a6 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:08.336131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630a98-5fe3-4ece-af62-012eb18102a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:08.336440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630a98-5fe3-4ece-af62-012eb18102a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:08.345102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49630a98-5fe3-4ece-af62-012eb18102a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:08.346714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49630a98-5fe3-4ece-af62-012eb18102a6 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:08.357259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 678/1360] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:10.581533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baff6b-cd99-446b-a07d-6d43377fafb1 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.582046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baff6b-cd99-446b-a07d-6d43377fafb1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.582141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baff6b-cd99-446b-a07d-6d43377fafb1 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.583598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 683/1361] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:10.588790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c111b9-9a78-43bb-897f-c08df0baacdb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.589613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c111b9-9a78-43bb-897f-c08df0baacdb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.590263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c111b9-9a78-43bb-897f-c08df0baacdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.610683 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-17c111b9-9a78-43bb-897f-c08df0baacdb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:10.612263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-17c111b9-9a78-43bb-897f-c08df0baacdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:10.622274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 679/1362] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:10.666857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baff6b-cd99-446b-a07d-6d43377fafb1 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:10.684592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baff6b-cd99-446b-a07d-6d43377fafb1 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:10.691931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646cd46-162e-46a3-bb8e-04399ad8d57a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:10.692891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646cd46-162e-46a3-bb8e-04399ad8d57a service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:10.693391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646cd46-162e-46a3-bb8e-04399ad8d57a service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:10.694128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646cd46-162e-46a3-bb8e-04399ad8d57a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:10.705093 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646cd46-162e-46a3-bb8e-04399ad8d57a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:10.708098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646cd46-162e-46a3-bb8e-04399ad8d57a service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:10.721376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 684/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:13.086129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158629-47f8-4ff7-9c04-5487b910414c None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.086637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158629-47f8-4ff7-9c04-5487b910414c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.086745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158629-47f8-4ff7-9c04-5487b910414c None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.088159 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 680/1364] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:13.093506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd275ed-3689-49f1-9a49-d80cbe681ac5 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.094363 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd275ed-3689-49f1-9a49-d80cbe681ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.094862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd275ed-3689-49f1-9a49-d80cbe681ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.113208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-3fd275ed-3689-49f1-9a49-d80cbe681ac5 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:13.114654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3fd275ed-3689-49f1-9a49-d80cbe681ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:13.136768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 685/1365] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:13.170949 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0367c59-4710-4f8e-89bf-2344b4d38da5 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.171238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0367c59-4710-4f8e-89bf-2344b4d38da5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.171519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0367c59-4710-4f8e-89bf-2344b4d38da5 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.172939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 681/1366] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jun 20 06:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:13.178400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b70ab-8c4a-4805-b51e-563555fe4de1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.178786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b70ab-8c4a-4805-b51e-563555fe4de1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.179132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b70ab-8c4a-4805-b51e-563555fe4de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.197663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-ec4b70ab-8c4a-4805-b51e-563555fe4de1 None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:13.199057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ec4b70ab-8c4a-4805-b51e-563555fe4de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:13.209020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 686/1367] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jun 20 06:00:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:13.217707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0367c59-4710-4f8e-89bf-2344b4d38da5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:13.232908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0367c59-4710-4f8e-89bf-2344b4d38da5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:13.238670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc804ca9-1075-44d9-8f95-bc2f664d423f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:13.239342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc804ca9-1075-44d9-8f95-bc2f664d423f service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:13.239622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc804ca9-1075-44d9-8f95-bc2f664d423f service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:13.239921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc804ca9-1075-44d9-8f95-bc2f664d423f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:13.248763 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc804ca9-1075-44d9-8f95-bc2f664d423f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:13.250371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc804ca9-1075-44d9-8f95-bc2f664d423f service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:13.259711 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 682/1368] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:15.377223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e087d7-1679-4256-a5af-fa30fa07aff3 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.377777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e087d7-1679-4256-a5af-fa30fa07aff3 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.377777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e087d7-1679-4256-a5af-fa30fa07aff3 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.379154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 687/1369] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:15.385266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625bead-882a-4e77-9dfc-d63c49f158d4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.385803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625bead-882a-4e77-9dfc-d63c49f158d4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.385803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625bead-882a-4e77-9dfc-d63c49f158d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.407486 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9625bead-882a-4e77-9dfc-d63c49f158d4 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:15.408972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9625bead-882a-4e77-9dfc-d63c49f158d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:15.417641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 683/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:00:15.463792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e087d7-1679-4256-a5af-fa30fa07aff3 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:15.478756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e087d7-1679-4256-a5af-fa30fa07aff3 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:15.484234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7e259-b7e0-428f-a1c7-7b8ab28ecf53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:15.484899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e259-b7e0-428f-a1c7-7b8ab28ecf53 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:15.485388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e259-b7e0-428f-a1c7-7b8ab28ecf53 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:15.485670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7e259-b7e0-428f-a1c7-7b8ab28ecf53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:15.494603 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7e259-b7e0-428f-a1c7-7b8ab28ecf53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:15.496201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7e259-b7e0-428f-a1c7-7b8ab28ecf53 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:15.506131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 688/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:16.147629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba687f8-2890-4716-969b-70dfcaeccb47 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:16.147918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba687f8-2890-4716-969b-70dfcaeccb47 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:16.148275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba687f8-2890-4716-969b-70dfcaeccb47 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:16.149929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 684/1372] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:16.155168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa7cf-1b3b-40a1-9fa3-66317625f6ac None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:16.155459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa7cf-1b3b-40a1-9fa3-66317625f6ac None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:16.155737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aa7cf-1b3b-40a1-9fa3-66317625f6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:16.175587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d36aa7cf-1b3b-40a1-9fa3-66317625f6ac None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:16.176802 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d36aa7cf-1b3b-40a1-9fa3-66317625f6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:16.188052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 689/1373] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:16.548956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c2deb-155b-41c6-b7cd-8ca1c80ede2f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:16.548956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c2deb-155b-41c6-b7cd-8ca1c80ede2f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:16.548956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c2deb-155b-41c6-b7cd-8ca1c80ede2f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:16.550153 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 685/1374] 10.222.0.13 () {54 vars in 963 bytes} [Mon Jun 20 06:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:16.553869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ad8f-f29b-4973-9abf-5a96b508b281 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:16.554703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ad8f-f29b-4973-9abf-5a96b508b281 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:16.555244 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3ad8f-f29b-4973-9abf-5a96b508b281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:16.608370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-19b3ad8f-f29b-4973-9abf-5a96b508b281 None None] MFA Rules not processed for user `e56cc5970ff645e594f50a0a204f44d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:16.609968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-19b3ad8f-f29b-4973-9abf-5a96b508b281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:16.677666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 690/1375] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Jun 20 06:00:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:00:16.685764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c2deb-155b-41c6-b7cd-8ca1c80ede2f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:16.697796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c2deb-155b-41c6-b7cd-8ca1c80ede2f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:16.701926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77008d8-fb4b-4559-88cf-bee9a4bc51e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:16.702650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77008d8-fb4b-4559-88cf-bee9a4bc51e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:16.703010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77008d8-fb4b-4559-88cf-bee9a4bc51e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:16.703363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77008d8-fb4b-4559-88cf-bee9a4bc51e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:16.714667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77008d8-fb4b-4559-88cf-bee9a4bc51e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:16.716229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77008d8-fb4b-4559-88cf-bee9a4bc51e0 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:16.727434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 686/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:17.586012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39947090-b613-491c-88c4-ec30c711fd99 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.586723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39947090-b613-491c-88c4-ec30c711fd99 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.586723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39947090-b613-491c-88c4-ec30c711fd99 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.587987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 691/1377] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:00:17.598639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762e73-ce04-4eb5-b828-5afbd5d12717 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.599401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762e73-ce04-4eb5-b828-5afbd5d12717 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.599709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762e73-ce04-4eb5-b828-5afbd5d12717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.630888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4b762e73-ce04-4eb5-b828-5afbd5d12717 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:17.632090 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4b762e73-ce04-4eb5-b828-5afbd5d12717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:17.640028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 687/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:17.683565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39947090-b613-491c-88c4-ec30c711fd99 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:17.698196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39947090-b613-491c-88c4-ec30c711fd99 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:17.703803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78a507-e9d5-4124-bf2f-bf6131f97607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:17.704563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a507-e9d5-4124-bf2f-bf6131f97607 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:17.704918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a507-e9d5-4124-bf2f-bf6131f97607 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:17.705264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78a507-e9d5-4124-bf2f-bf6131f97607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:17.714206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78a507-e9d5-4124-bf2f-bf6131f97607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:17.715872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78a507-e9d5-4124-bf2f-bf6131f97607 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:17.719856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:17.727551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 692/1379] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:19.782917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0640a4-cb4d-442c-9660-32bc15a4c279 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.783420 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0640a4-cb4d-442c-9660-32bc15a4c279 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.783420 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0640a4-cb4d-442c-9660-32bc15a4c279 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.784883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 688/1380] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:19.790698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da56a7-aa2d-494e-a29e-aed1d9ce3f1e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.791101 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da56a7-aa2d-494e-a29e-aed1d9ce3f1e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.791278 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da56a7-aa2d-494e-a29e-aed1d9ce3f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.808916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-e4da56a7-aa2d-494e-a29e-aed1d9ce3f1e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:19.810103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e4da56a7-aa2d-494e-a29e-aed1d9ce3f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:19.817850 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 693/1381] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:19.861928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0640a4-cb4d-442c-9660-32bc15a4c279 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:19.876248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0640a4-cb4d-442c-9660-32bc15a4c279 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:19.881637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607098b-acb6-44e0-a7e0-fdaef6073f60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:19.882268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607098b-acb6-44e0-a7e0-fdaef6073f60 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:19.882550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607098b-acb6-44e0-a7e0-fdaef6073f60 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:19.882829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607098b-acb6-44e0-a7e0-fdaef6073f60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:19.891491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607098b-acb6-44e0-a7e0-fdaef6073f60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:19.893091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607098b-acb6-44e0-a7e0-fdaef6073f60 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:19.903152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 689/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:21.970818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27a365-b098-4427-b8cc-60fde9d856aa None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:21.971369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27a365-b098-4427-b8cc-60fde9d856aa None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:21.971369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27a365-b098-4427-b8cc-60fde9d856aa None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:21.972803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 694/1383] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:21.978508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4ab41-6d54-4eaa-a70d-a9b686fe9c45 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:21.978915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4ab41-6d54-4eaa-a70d-a9b686fe9c45 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:21.979095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4ab41-6d54-4eaa-a70d-a9b686fe9c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:21.998836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-56b4ab41-6d54-4eaa-a70d-a9b686fe9c45 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:22.000023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-56b4ab41-6d54-4eaa-a70d-a9b686fe9c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:22.011465 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 690/1384] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:22.052948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27a365-b098-4427-b8cc-60fde9d856aa None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:22.068402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27a365-b098-4427-b8cc-60fde9d856aa None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:22.073956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a10152-dde3-41d1-9292-d44cf652ffa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:22.074700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a10152-dde3-41d1-9292-d44cf652ffa7 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:22.075082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a10152-dde3-41d1-9292-d44cf652ffa7 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:22.075455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a10152-dde3-41d1-9292-d44cf652ffa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:22.084071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a10152-dde3-41d1-9292-d44cf652ffa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:22.085775 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a10152-dde3-41d1-9292-d44cf652ffa7 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:22.095962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 695/1385] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:24.148063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6e677-4257-48ca-be58-654097c9635e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:24.148063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6e677-4257-48ca-be58-654097c9635e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:24.148063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6e677-4257-48ca-be58-654097c9635e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:24.156523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad490e-e253-4e54-b375-4804fe0ac7f1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:24.156913 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad490e-e253-4e54-b375-4804fe0ac7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:24.157835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad490e-e253-4e54-b375-4804fe0ac7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:24.159799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 691/1386] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:24 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:24.181545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-14ad490e-e253-4e54-b375-4804fe0ac7f1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:24.182838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-14ad490e-e253-4e54-b375-4804fe0ac7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:24.196562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 696/1387] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:24.236761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6e677-4257-48ca-be58-654097c9635e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:24.253122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6e677-4257-48ca-be58-654097c9635e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:24.258892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a33d24-660c-4275-baeb-266ff681d321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:24.259545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a33d24-660c-4275-baeb-266ff681d321 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:24.259861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a33d24-660c-4275-baeb-266ff681d321 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:24.260142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a33d24-660c-4275-baeb-266ff681d321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:24.268765 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a33d24-660c-4275-baeb-266ff681d321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:24.270363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a33d24-660c-4275-baeb-266ff681d321 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:24.280765 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 692/1388] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:26.553476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4242e4-7b28-454c-b665-78d7e067f4af None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:26.554000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4242e4-7b28-454c-b665-78d7e067f4af None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:26.554000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4242e4-7b28-454c-b665-78d7e067f4af None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:26.556077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 697/1389] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:26.562312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8c99-1a62-4504-b650-552bdb86b234 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:26.562736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8c99-1a62-4504-b650-552bdb86b234 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:26.563108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a8c99-1a62-4504-b650-552bdb86b234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:26.588648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fe9a8c99-1a62-4504-b650-552bdb86b234 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:26.590251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fe9a8c99-1a62-4504-b650-552bdb86b234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:26.600266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 693/1390] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:26.648680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4242e4-7b28-454c-b665-78d7e067f4af None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:26.662936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4242e4-7b28-454c-b665-78d7e067f4af None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:26.668854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f88bb7-5a00-41e4-8dcb-72f490161972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:26.669490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f88bb7-5a00-41e4-8dcb-72f490161972 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:26.669729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f88bb7-5a00-41e4-8dcb-72f490161972 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:26.670006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f88bb7-5a00-41e4-8dcb-72f490161972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:26.678492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f88bb7-5a00-41e4-8dcb-72f490161972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:26.680742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f88bb7-5a00-41e4-8dcb-72f490161972 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:26.690705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 698/1391] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:00:28.917761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6825-0926-4594-97c7-eab088f56aa6 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.918354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6825-0926-4594-97c7-eab088f56aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.918461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b6825-0926-4594-97c7-eab088f56aa6 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.920260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 694/1392] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:28.925611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca51ac-a0e6-4f1b-9573-6f056427163a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:28.926027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca51ac-a0e6-4f1b-9573-6f056427163a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:28.926208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca51ac-a0e6-4f1b-9573-6f056427163a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:28.944654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-83ca51ac-a0e6-4f1b-9573-6f056427163a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:28.945955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-83ca51ac-a0e6-4f1b-9573-6f056427163a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:28.954241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 699/1393] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:29.000793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b6825-0926-4594-97c7-eab088f56aa6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:29.016260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b6825-0926-4594-97c7-eab088f56aa6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:29.024135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcd5aa-0a12-4980-b1d3-db8bcc0ad6ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:29.025588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd5aa-0a12-4980-b1d3-db8bcc0ad6ca service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:29.025970 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd5aa-0a12-4980-b1d3-db8bcc0ad6ca service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:29.026565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd5aa-0a12-4980-b1d3-db8bcc0ad6ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:29.039021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcd5aa-0a12-4980-b1d3-db8bcc0ad6ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:29.041165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcd5aa-0a12-4980-b1d3-db8bcc0ad6ca service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:29.054850 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 695/1394] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:31.169292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebbc62-20b6-47c3-885e-69f149c30e46 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.169831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebbc62-20b6-47c3-885e-69f149c30e46 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.169831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebbc62-20b6-47c3-885e-69f149c30e46 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.171224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 700/1395] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:00:31.176451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a6e3-1034-4650-abfa-a95189ba47da None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.176879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a6e3-1034-4650-abfa-a95189ba47da None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.177008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a6e3-1034-4650-abfa-a95189ba47da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.196223 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d186a6e3-1034-4650-abfa-a95189ba47da None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:31.197428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d186a6e3-1034-4650-abfa-a95189ba47da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:31.205094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 696/1396] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:31.249006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebbc62-20b6-47c3-885e-69f149c30e46 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:31.264399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebbc62-20b6-47c3-885e-69f149c30e46 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:31.269993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07528ee-3b0f-4b9e-b441-a45a5d5d80ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:31.270636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07528ee-3b0f-4b9e-b441-a45a5d5d80ab service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.271185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07528ee-3b0f-4b9e-b441-a45a5d5d80ab service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.271463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07528ee-3b0f-4b9e-b441-a45a5d5d80ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.279995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07528ee-3b0f-4b9e-b441-a45a5d5d80ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:31.281613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07528ee-3b0f-4b9e-b441-a45a5d5d80ab service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:31.291290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 701/1397] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:31.803132 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f586f-4926-40a8-a6f4-576d80a813e3 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.803432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f586f-4926-40a8-a6f4-576d80a813e3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.803713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f586f-4926-40a8-a6f4-576d80a813e3 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.805764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 697/1398] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:31.810941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714b6f3-b0f5-4321-a74d-e908b3540044 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.811235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714b6f3-b0f5-4321-a74d-e908b3540044 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.811519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714b6f3-b0f5-4321-a74d-e908b3540044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.829947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-0714b6f3-b0f5-4321-a74d-e908b3540044 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:31.831164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0714b6f3-b0f5-4321-a74d-e908b3540044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:31.839139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 702/1399] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:31.894975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af9f70-ee47-4b10-b666-fbf309f92f87 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.895261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af9f70-ee47-4b10-b666-fbf309f92f87 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.895537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af9f70-ee47-4b10-b666-fbf309f92f87 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.897268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 698/1400] 10.222.0.13 () {54 vars in 962 bytes} [Mon Jun 20 06:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:31.902339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e91e-b55e-40cf-b776-71e375fdd9dc None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:31.902636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e91e-b55e-40cf-b776-71e375fdd9dc None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:31.902921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459e91e-b55e-40cf-b776-71e375fdd9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:31.950133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-1459e91e-b55e-40cf-b776-71e375fdd9dc None None] MFA Rules not processed for user `80f36041751a446885608f5a3b1f37df`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:31.951474 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1459e91e-b55e-40cf-b776-71e375fdd9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:32.013655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 703/1401] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Jun 20 06:00:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:32.021586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af9f70-ee47-4b10-b666-fbf309f92f87 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:32.032793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af9f70-ee47-4b10-b666-fbf309f92f87 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:32.036384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf62638-1897-4521-a6b1-1a537e7ca3f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f36041751a446885608f5a3b1f37df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:32.037023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62638-1897-4521-a6b1-1a537e7ca3f6 service glance] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:32.037304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62638-1897-4521-a6b1-1a537e7ca3f6 service glance] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:32.037577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62638-1897-4521-a6b1-1a537e7ca3f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:32.046807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf62638-1897-4521-a6b1-1a537e7ca3f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:32.048243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf62638-1897-4521-a6b1-1a537e7ca3f6 service glance] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:32.058742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 699/1402] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:00:32.762807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f745e44-edb5-4cbc-a163-e2f9760b2eb0 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:32.763381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f745e44-edb5-4cbc-a163-e2f9760b2eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:32.763381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f745e44-edb5-4cbc-a163-e2f9760b2eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:32.811559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-6f745e44-edb5-4cbc-a163-e2f9760b2eb0 None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:32.812790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6f745e44-edb5-4cbc-a163-e2f9760b2eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:32.851417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:32.875127 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 704/1403] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:00:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:32.920812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1028b22-2279-4a2b-a47c-b597aafc0ac7 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:32.921295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1028b22-2279-4a2b-a47c-b597aafc0ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:32.921391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1028b22-2279-4a2b-a47c-b597aafc0ac7 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:32.922749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 700/1404] 10.222.0.13 () {54 vars in 942 bytes} [Mon Jun 20 06:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:32.931182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2bd5e-7f55-479a-9f71-fc2e67e41958 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:32.931480 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2bd5e-7f55-479a-9f71-fc2e67e41958 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:32.931765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c2bd5e-7f55-479a-9f71-fc2e67e41958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:32.993978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-86c2bd5e-7f55-479a-9f71-fc2e67e41958 None None] MFA Rules not processed for user `265894b988a640f0b17846d4986b670a`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:32.995432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-86c2bd5e-7f55-479a-9f71-fc2e67e41958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:33.073114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 705/1405] 10.222.0.13 () {58 vars in 1039 bytes} [Mon Jun 20 06:00:32 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:33.082376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1028b22-2279-4a2b-a47c-b597aafc0ac7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:33.090542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=61 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:33.097271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1028b22-2279-4a2b-a47c-b597aafc0ac7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:33.102244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633f993-d57f-408f-8a4e-b28c67a29f64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:33.102882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633f993-d57f-408f-8a4e-b28c67a29f64 service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.103168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633f993-d57f-408f-8a4e-b28c67a29f64 service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.103447 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633f993-d57f-408f-8a4e-b28c67a29f64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.111461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633f993-d57f-408f-8a4e-b28c67a29f64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:33.113083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633f993-d57f-408f-8a4e-b28c67a29f64 service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:33.121113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 701/1406] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:00:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:00:33.369182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952661-56a6-4f6b-9a0f-dc649892ff74 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.369545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952661-56a6-4f6b-9a0f-dc649892ff74 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.369757 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47952661-56a6-4f6b-9a0f-dc649892ff74 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.371283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 706/1407] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:00:33.385304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1767a-4d88-4e45-af66-ef64dde8c9a5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.385645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1767a-4d88-4e45-af66-ef64dde8c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.385862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1767a-4d88-4e45-af66-ef64dde8c9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.404460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ccf1767a-4d88-4e45-af66-ef64dde8c9a5 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:33.405668 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ccf1767a-4d88-4e45-af66-ef64dde8c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:33.414239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 702/1408] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:33.457446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47952661-56a6-4f6b-9a0f-dc649892ff74 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:33.472582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47952661-56a6-4f6b-9a0f-dc649892ff74 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:33.478226 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d40f65-8256-494c-b68f-0d7166cf5416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:33.478860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d40f65-8256-494c-b68f-0d7166cf5416 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:33.479149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d40f65-8256-494c-b68f-0d7166cf5416 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:33.479419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d40f65-8256-494c-b68f-0d7166cf5416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:33.488256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d40f65-8256-494c-b68f-0d7166cf5416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:33.489953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d40f65-8256-494c-b68f-0d7166cf5416 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:33.501010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 707/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:43.399243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=8 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:43.497224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=59 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:00:55.097121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1137-7625-4286-b193-38db8f578eea None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.097607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1137-7625-4286-b193-38db8f578eea None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.097709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1137-7625-4286-b193-38db8f578eea None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.099089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 703/1410] 10.222.0.13 () {54 vars in 918 bytes} [Mon Jun 20 06:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:55.104248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8d9c9-18a0-4e90-b7a4-b9efdb229b4c None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.104706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8d9c9-18a0-4e90-b7a4-b9efdb229b4c None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.104846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8d9c9-18a0-4e90-b7a4-b9efdb229b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.122379 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-92c8d9c9-18a0-4e90-b7a4-b9efdb229b4c None None] MFA Rules not processed for user `0a5e0b53aafc4bf3a23a7882ed12a89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:55.123568 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-92c8d9c9-18a0-4e90-b7a4-b9efdb229b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:55.132493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 708/1411] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Jun 20 06:00:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:55.146558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92dd82-ad0d-4b4d-97d3-969adcd16d69 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.146847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92dd82-ad0d-4b4d-97d3-969adcd16d69 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.147126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92dd82-ad0d-4b4d-97d3-969adcd16d69 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.149050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 704/1412] 10.222.0.13 () {54 vars in 918 bytes} [Mon Jun 20 06:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:55.153486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d697c8c-a05e-44b2-b71c-c32cbc2248eb None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:55.153779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d697c8c-a05e-44b2-b71c-c32cbc2248eb None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:55.154064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d697c8c-a05e-44b2-b71c-c32cbc2248eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:55.171233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-9d697c8c-a05e-44b2-b71c-c32cbc2248eb None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:55.172460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9d697c8c-a05e-44b2-b71c-c32cbc2248eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:55.182023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 709/1413] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Jun 20 06:00:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:57.666624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843aa00-1aa8-4363-9c0d-3d6cbb9d12c1 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.667201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843aa00-1aa8-4363-9c0d-3d6cbb9d12c1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.667201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843aa00-1aa8-4363-9c0d-3d6cbb9d12c1 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.668600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:57.673700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cfd6c-3517-4483-a0ed-3dee074048e7 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.674118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cfd6c-3517-4483-a0ed-3dee074048e7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.674288 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cfd6c-3517-4483-a0ed-3dee074048e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.691616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8c6cfd6c-3517-4483-a0ed-3dee074048e7 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:57.692863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8c6cfd6c-3517-4483-a0ed-3dee074048e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:57.700635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:57.743905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843aa00-1aa8-4363-9c0d-3d6cbb9d12c1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:57.758653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843aa00-1aa8-4363-9c0d-3d6cbb9d12c1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:57.764009 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5275c-1ff9-4e63-91e3-8d0d15f03acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:57.764662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5275c-1ff9-4e63-91e3-8d0d15f03acf service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:57.764943 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5275c-1ff9-4e63-91e3-8d0d15f03acf service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:57.765213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5275c-1ff9-4e63-91e3-8d0d15f03acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:57.773926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5275c-1ff9-4e63-91e3-8d0d15f03acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:57.775492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5275c-1ff9-4e63-91e3-8d0d15f03acf service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:57.784757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 706/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:58.677561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f46f-2213-4b05-8b01-83b57e229607 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.678137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f46f-2213-4b05-8b01-83b57e229607 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.678137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f46f-2213-4b05-8b01-83b57e229607 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.679566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:58.684488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd25bf-b377-4b23-987e-16e7b09699f2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.684907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd25bf-b377-4b23-987e-16e7b09699f2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.685059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd25bf-b377-4b23-987e-16e7b09699f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.703459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-98cd25bf-b377-4b23-987e-16e7b09699f2 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:58.704712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-98cd25bf-b377-4b23-987e-16e7b09699f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:58.713151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:58.863227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4f46f-2213-4b05-8b01-83b57e229607 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:00:58.877954 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4f46f-2213-4b05-8b01-83b57e229607 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:00:58.883343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5ba7b-4255-4666-ab36-dc8fe387c34a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:00:58.883969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5ba7b-4255-4666-ab36-dc8fe387c34a service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:58.884257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5ba7b-4255-4666-ab36-dc8fe387c34a service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:58.884562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5ba7b-4255-4666-ab36-dc8fe387c34a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:58.892608 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5ba7b-4255-4666-ab36-dc8fe387c34a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:00:58.894182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5ba7b-4255-4666-ab36-dc8fe387c34a service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:00:58.905221 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 712/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:00:59.808660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0854b-a580-4f67-afe0-b64c34197978 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.809226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0854b-a580-4f67-afe0-b64c34197978 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.809226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0854b-a580-4f67-afe0-b64c34197978 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.810598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:00:59.815558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2b903-4bbe-4a46-baee-1bb3a370027d None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:00:59.816031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2b903-4bbe-4a46-baee-1bb3a370027d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:00:59.816130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2b903-4bbe-4a46-baee-1bb3a370027d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:00:59.833425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8cf2b903-4bbe-4a46-baee-1bb3a370027d None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:00:59.834599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8cf2b903-4bbe-4a46-baee-1bb3a370027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:00:59.842731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:00:59.993879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0854b-a580-4f67-afe0-b64c34197978 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:00.008306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0854b-a580-4f67-afe0-b64c34197978 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:00.013666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4eef94-228e-4601-8c40-57e742c776c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:00.014302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eef94-228e-4601-8c40-57e742c776c3 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.014591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eef94-228e-4601-8c40-57e742c776c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.014869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4eef94-228e-4601-8c40-57e742c776c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.023733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eef94-228e-4601-8c40-57e742c776c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:00.025363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4eef94-228e-4601-8c40-57e742c776c3 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:00.034711 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 709/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:00.882492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366f5da-9c72-4da0-90d0-eb3cb63717ab None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.883061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366f5da-9c72-4da0-90d0-eb3cb63717ab None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.883061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366f5da-9c72-4da0-90d0-eb3cb63717ab None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.884682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:00.889520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79106bc2-d5cb-412e-bc70-f8c1bb418d44 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:00.889993 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79106bc2-d5cb-412e-bc70-f8c1bb418d44 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:00.890101 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79106bc2-d5cb-412e-bc70-f8c1bb418d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:00.908439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-79106bc2-d5cb-412e-bc70-f8c1bb418d44 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:00.909630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-79106bc2-d5cb-412e-bc70-f8c1bb418d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:00.917442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:01.068556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366f5da-9c72-4da0-90d0-eb3cb63717ab None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:01.083012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366f5da-9c72-4da0-90d0-eb3cb63717ab None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:01.089115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a9baa-1ac9-400e-9b01-80a2a6cdfffa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:01.089739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9baa-1ac9-400e-9b01-80a2a6cdfffa service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:01.090025 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9baa-1ac9-400e-9b01-80a2a6cdfffa service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:01.090301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a9baa-1ac9-400e-9b01-80a2a6cdfffa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:01.098357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a9baa-1ac9-400e-9b01-80a2a6cdfffa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:01.099944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a9baa-1ac9-400e-9b01-80a2a6cdfffa service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:01.109265 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 715/1425] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:01.963962 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b4f6-de3b-4247-b517-df30180df29c None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:01.964571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b4f6-de3b-4247-b517-df30180df29c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:01.964571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0b4f6-de3b-4247-b517-df30180df29c None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:01.965925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:01.970841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abae52-f46f-4b96-91bc-c44e62ed7dbb None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:01.971254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abae52-f46f-4b96-91bc-c44e62ed7dbb None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:01.971408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abae52-f46f-4b96-91bc-c44e62ed7dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:01.989830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d0abae52-f46f-4b96-91bc-c44e62ed7dbb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:01.991232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d0abae52-f46f-4b96-91bc-c44e62ed7dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:01.999521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:02.146733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0b4f6-de3b-4247-b517-df30180df29c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:02.161363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0b4f6-de3b-4247-b517-df30180df29c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:02.167263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bca4de-21eb-4a5b-8951-7393e504e5ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:02.167891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca4de-21eb-4a5b-8951-7393e504e5ab service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:02.168173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca4de-21eb-4a5b-8951-7393e504e5ab service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:02.168490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bca4de-21eb-4a5b-8951-7393e504e5ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:02.176434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bca4de-21eb-4a5b-8951-7393e504e5ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:02.178014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bca4de-21eb-4a5b-8951-7393e504e5ab service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:02.187198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 712/1428] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:02.989178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df716-0a3c-47e3-b24d-ac0164fb7f47 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:02.989724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df716-0a3c-47e3-b24d-ac0164fb7f47 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:02.989724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447df716-0a3c-47e3-b24d-ac0164fb7f47 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:02.992129 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:02.997311 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba6d7c-c17a-4603-9fd0-af447e3c3cc1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:02.997740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba6d7c-c17a-4603-9fd0-af447e3c3cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:02.997879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba6d7c-c17a-4603-9fd0-af447e3c3cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.016096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-15ba6d7c-c17a-4603-9fd0-af447e3c3cc1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:03.017339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-15ba6d7c-c17a-4603-9fd0-af447e3c3cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:03.025356 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:03.172293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447df716-0a3c-47e3-b24d-ac0164fb7f47 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:03.187311 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447df716-0a3c-47e3-b24d-ac0164fb7f47 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:03.192696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6498ab5-403d-4e52-b38d-2706c1be001a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:03.193324 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6498ab5-403d-4e52-b38d-2706c1be001a service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:03.193612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6498ab5-403d-4e52-b38d-2706c1be001a service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:03.193893 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6498ab5-403d-4e52-b38d-2706c1be001a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:03.201993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6498ab5-403d-4e52-b38d-2706c1be001a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:03.203581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6498ab5-403d-4e52-b38d-2706c1be001a service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:03.213008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 718/1431] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:04.012063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c8f4e-00f2-42a5-9320-712ae82cf6d4 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.012649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c8f4e-00f2-42a5-9320-712ae82cf6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.012649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c8f4e-00f2-42a5-9320-712ae82cf6d4 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.014008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:04.019167 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c06e9-2ab7-4461-bdbf-d39513b6d239 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.019557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c06e9-2ab7-4461-bdbf-d39513b6d239 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.019733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c06e9-2ab7-4461-bdbf-d39513b6d239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.037608 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-9b9c06e9-2ab7-4461-bdbf-d39513b6d239 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:04.039310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9b9c06e9-2ab7-4461-bdbf-d39513b6d239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:04.047043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:04.196385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c8f4e-00f2-42a5-9320-712ae82cf6d4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:04.211137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c8f4e-00f2-42a5-9320-712ae82cf6d4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:04.216736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592da62-0329-409e-b463-7b2a7b4a1aa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:04.217371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592da62-0329-409e-b463-7b2a7b4a1aa5 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:04.217706 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592da62-0329-409e-b463-7b2a7b4a1aa5 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:04.217986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592da62-0329-409e-b463-7b2a7b4a1aa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:04.226720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592da62-0329-409e-b463-7b2a7b4a1aa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:04.228304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592da62-0329-409e-b463-7b2a7b4a1aa5 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:04.238012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 715/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:05.041945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aa267-6f7a-4d0b-8853-4ed76c3555e8 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:05.042489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aa267-6f7a-4d0b-8853-4ed76c3555e8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:05.042489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aa267-6f7a-4d0b-8853-4ed76c3555e8 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:05.043853 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:05.048833 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140882b-21c5-44b3-a2b4-8994d9a4779c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:05.049213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140882b-21c5-44b3-a2b4-8994d9a4779c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:05.049399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140882b-21c5-44b3-a2b4-8994d9a4779c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:05.067472 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9140882b-21c5-44b3-a2b4-8994d9a4779c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:05.068708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9140882b-21c5-44b3-a2b4-8994d9a4779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:05.077129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:05.228203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aa267-6f7a-4d0b-8853-4ed76c3555e8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:05.242901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aa267-6f7a-4d0b-8853-4ed76c3555e8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:05.248207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6a5c5-4a16-4ac7-bade-62c4abd83be5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:05.248865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6a5c5-4a16-4ac7-bade-62c4abd83be5 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:05.249150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6a5c5-4a16-4ac7-bade-62c4abd83be5 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:05.249424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6a5c5-4a16-4ac7-bade-62c4abd83be5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:05.258122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6a5c5-4a16-4ac7-bade-62c4abd83be5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:05.259687 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6a5c5-4a16-4ac7-bade-62c4abd83be5 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:05.268958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 721/1437] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:06.067336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be807b40-1359-44c2-b38f-942d3b0debf5 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:06.067906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be807b40-1359-44c2-b38f-942d3b0debf5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:06.067906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be807b40-1359-44c2-b38f-942d3b0debf5 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:06.069818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:06.074612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2df5c-fad2-4f7f-bc34-b782d5b2ed47 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:06.075054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2df5c-fad2-4f7f-bc34-b782d5b2ed47 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:06.075152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2df5c-fad2-4f7f-bc34-b782d5b2ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:06.093110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-afc2df5c-fad2-4f7f-bc34-b782d5b2ed47 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:06.094288 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-afc2df5c-fad2-4f7f-bc34-b782d5b2ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:06.101935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:06.250854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be807b40-1359-44c2-b38f-942d3b0debf5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:06.264826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be807b40-1359-44c2-b38f-942d3b0debf5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:06.270048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08398abd-11f4-49af-b892-d450b13d373a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:06.270678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398abd-11f4-49af-b892-d450b13d373a service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:06.270958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398abd-11f4-49af-b892-d450b13d373a service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:06.271491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08398abd-11f4-49af-b892-d450b13d373a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:06.279648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08398abd-11f4-49af-b892-d450b13d373a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:06.281248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08398abd-11f4-49af-b892-d450b13d373a service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:06.292018 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 718/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:01:08.209240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5ae2-968b-40ef-8cbe-23f8f31ccc04 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.210324 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5ae2-968b-40ef-8cbe-23f8f31ccc04 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.210324 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb5ae2-968b-40ef-8cbe-23f8f31ccc04 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.211657 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:08.216973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7252b65-6242-47c3-8652-107eab5ce504 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.217371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7252b65-6242-47c3-8652-107eab5ce504 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.217651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7252b65-6242-47c3-8652-107eab5ce504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.236131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d7252b65-6242-47c3-8652-107eab5ce504 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:08.236962 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d7252b65-6242-47c3-8652-107eab5ce504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:08.247756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:08.285567 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb5ae2-968b-40ef-8cbe-23f8f31ccc04 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:08.298166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb5ae2-968b-40ef-8cbe-23f8f31ccc04 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:08.303293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b518ade-b7f2-4287-b1d1-cb36f704204c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:08.303293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b518ade-b7f2-4287-b1d1-cb36f704204c service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:08.304549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b518ade-b7f2-4287-b1d1-cb36f704204c service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:08.304715 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b518ade-b7f2-4287-b1d1-cb36f704204c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:08.314059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b518ade-b7f2-4287-b1d1-cb36f704204c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:08.315503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b518ade-b7f2-4287-b1d1-cb36f704204c service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:08.325437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 724/1443] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:10.506867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aad46-8840-4009-9f6b-1b848e45e40c None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.507398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aad46-8840-4009-9f6b-1b848e45e40c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.507398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180aad46-8840-4009-9f6b-1b848e45e40c None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.508788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:10.514047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ad9a6-fedf-4c7d-b0d5-1f0594fb60fd None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.514449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ad9a6-fedf-4c7d-b0d5-1f0594fb60fd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.514631 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ad9a6-fedf-4c7d-b0d5-1f0594fb60fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.533601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-6c3ad9a6-fedf-4c7d-b0d5-1f0594fb60fd None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:10.534818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6c3ad9a6-fedf-4c7d-b0d5-1f0594fb60fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:10.543091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:10.580295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aad46-8840-4009-9f6b-1b848e45e40c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:10.591213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180aad46-8840-4009-9f6b-1b848e45e40c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:10.594637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f52169-4698-474b-8e06-59471d6837e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:10.595260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52169-4698-474b-8e06-59471d6837e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:10.595541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52169-4698-474b-8e06-59471d6837e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:10.595812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f52169-4698-474b-8e06-59471d6837e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:10.604972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f52169-4698-474b-8e06-59471d6837e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:10.606395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f52169-4698-474b-8e06-59471d6837e5 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:10.615530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 721/1446] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:12.912454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacec066-f58f-4881-b83b-8bc324399386 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.913085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacec066-f58f-4881-b83b-8bc324399386 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.913493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacec066-f58f-4881-b83b-8bc324399386 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.915864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:01:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:12.920978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7ea8-f2f3-48ea-88d6-3a9cec11ed4f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:12.921375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7ea8-f2f3-48ea-88d6-3a9cec11ed4f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:12.921534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7ea8-f2f3-48ea-88d6-3a9cec11ed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:12.938783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-01fe7ea8-f2f3-48ea-88d6-3a9cec11ed4f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:12.939960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-01fe7ea8-f2f3-48ea-88d6-3a9cec11ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:12.948109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:12.986005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacec066-f58f-4881-b83b-8bc324399386 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:12.997313 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacec066-f58f-4881-b83b-8bc324399386 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:13.000824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894ece3-5e6c-4b89-a492-3500f2da5182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:13.001456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894ece3-5e6c-4b89-a492-3500f2da5182 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:13.001741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894ece3-5e6c-4b89-a492-3500f2da5182 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:13.002017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894ece3-5e6c-4b89-a492-3500f2da5182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:13.011560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894ece3-5e6c-4b89-a492-3500f2da5182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:13.013026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894ece3-5e6c-4b89-a492-3500f2da5182 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:13.023341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 727/1449] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:15.170460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011cbf-4948-4619-b00f-5b8e49e9010e None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.171012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011cbf-4948-4619-b00f-5b8e49e9010e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.171118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011cbf-4948-4619-b00f-5b8e49e9010e None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.172493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:15.177650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a38bb2-13a8-4428-877d-e2a97cd9d7ac None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.178068 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a38bb2-13a8-4428-877d-e2a97cd9d7ac None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.178194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a38bb2-13a8-4428-877d-e2a97cd9d7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.195903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-f0a38bb2-13a8-4428-877d-e2a97cd9d7ac None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:15.197127 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f0a38bb2-13a8-4428-877d-e2a97cd9d7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:15.204846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:15.243731 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d011cbf-4948-4619-b00f-5b8e49e9010e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:15.254492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d011cbf-4948-4619-b00f-5b8e49e9010e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:15.257961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704d9dd-0b35-4856-b85b-7d68c61f6a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:15.258586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704d9dd-0b35-4856-b85b-7d68c61f6a14 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:15.258868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704d9dd-0b35-4856-b85b-7d68c61f6a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:15.259140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704d9dd-0b35-4856-b85b-7d68c61f6a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:15.267888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704d9dd-0b35-4856-b85b-7d68c61f6a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:15.269347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704d9dd-0b35-4856-b85b-7d68c61f6a14 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:15.278878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 724/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:17.437871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbeffa-61b8-4964-82b0-4dcf72868cd0 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.438463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbeffa-61b8-4964-82b0-4dcf72868cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.438463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbeffa-61b8-4964-82b0-4dcf72868cd0 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.439814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:17.445786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2f32-7757-45c2-a086-d70b2fb0a564 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.446220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2f32-7757-45c2-a086-d70b2fb0a564 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.446351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2f32-7757-45c2-a086-d70b2fb0a564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.465803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1e9a2f32-7757-45c2-a086-d70b2fb0a564 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:17.467070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1e9a2f32-7757-45c2-a086-d70b2fb0a564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:17.475147 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:17.517081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbeffa-61b8-4964-82b0-4dcf72868cd0 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:17.528686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbeffa-61b8-4964-82b0-4dcf72868cd0 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:17.532235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34862c14-ab5a-43f7-9cdf-5bbcc7486757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:17.532894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862c14-ab5a-43f7-9cdf-5bbcc7486757 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:17.533179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862c14-ab5a-43f7-9cdf-5bbcc7486757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:17.533454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862c14-ab5a-43f7-9cdf-5bbcc7486757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:17.542318 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34862c14-ab5a-43f7-9cdf-5bbcc7486757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:17.543748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34862c14-ab5a-43f7-9cdf-5bbcc7486757 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:17.553240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 730/1455] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:19.715670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b603ff-ed25-46b9-b79c-92e3cda1e04f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.716161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b603ff-ed25-46b9-b79c-92e3cda1e04f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.716278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b603ff-ed25-46b9-b79c-92e3cda1e04f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.717634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:19.722897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9443-82bc-4e6c-a4f3-2108f3ab269a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.723312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9443-82bc-4e6c-a4f3-2108f3ab269a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.723459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9443-82bc-4e6c-a4f3-2108f3ab269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.740740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-536e9443-82bc-4e6c-a4f3-2108f3ab269a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:19.741946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-536e9443-82bc-4e6c-a4f3-2108f3ab269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:19.749695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:19.788929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b603ff-ed25-46b9-b79c-92e3cda1e04f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:19.799995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b603ff-ed25-46b9-b79c-92e3cda1e04f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:19.803488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736017c-a391-4f7a-a8a5-d4813a4f37db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:19.804119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736017c-a391-4f7a-a8a5-d4813a4f37db service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:19.804435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736017c-a391-4f7a-a8a5-d4813a4f37db service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:19.804715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736017c-a391-4f7a-a8a5-d4813a4f37db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:19.813464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736017c-a391-4f7a-a8a5-d4813a4f37db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:19.814893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736017c-a391-4f7a-a8a5-d4813a4f37db service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:19.824659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 727/1458] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:21.884135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842e08a-ae2a-4ec6-a670-8e71121035ce None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:21.884709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842e08a-ae2a-4ec6-a670-8e71121035ce None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:21.884709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842e08a-ae2a-4ec6-a670-8e71121035ce None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:21.886107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:21.891294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9017-bf52-410f-963a-c44d60ccdcf6 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:21.891730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9017-bf52-410f-963a-c44d60ccdcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:21.891854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9017-bf52-410f-963a-c44d60ccdcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:21.909433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cffc9017-bf52-410f-963a-c44d60ccdcf6 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:21.910629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cffc9017-bf52-410f-963a-c44d60ccdcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:21.919196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:21.956405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842e08a-ae2a-4ec6-a670-8e71121035ce None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:21.967129 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842e08a-ae2a-4ec6-a670-8e71121035ce None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:21.970677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0a619-ed79-4682-ba66-5ace0c217798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:21.971303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a619-ed79-4682-ba66-5ace0c217798 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:21.971582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a619-ed79-4682-ba66-5ace0c217798 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:21.971855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0a619-ed79-4682-ba66-5ace0c217798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:21.981077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0a619-ed79-4682-ba66-5ace0c217798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:21.982487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0a619-ed79-4682-ba66-5ace0c217798 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:21.992984 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 733/1461] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:24.055655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2dbf-7a47-4ffd-9b75-b800a1371f2f None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:24.056231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2dbf-7a47-4ffd-9b75-b800a1371f2f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:24.056231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed2dbf-7a47-4ffd-9b75-b800a1371f2f None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:24.057621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:24.062707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0b2a6-199c-449b-908f-17943f3323e3 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:24.063097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0b2a6-199c-449b-908f-17943f3323e3 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:24.063289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0b2a6-199c-449b-908f-17943f3323e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:24.070068 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=79 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:24.082337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-05d0b2a6-199c-449b-908f-17943f3323e3 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:24.083531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-05d0b2a6-199c-449b-908f-17943f3323e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:24.091806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:24.128742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed2dbf-7a47-4ffd-9b75-b800a1371f2f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:24.134727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=73 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:24.141124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed2dbf-7a47-4ffd-9b75-b800a1371f2f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:24.144623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b60b7f-333a-44e8-bb05-c46b85e4a5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:24.145258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b60b7f-333a-44e8-bb05-c46b85e4a5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:24.145540 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b60b7f-333a-44e8-bb05-c46b85e4a5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:24.145814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b60b7f-333a-44e8-bb05-c46b85e4a5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:24.155022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b60b7f-333a-44e8-bb05-c46b85e4a5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:24.156510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b60b7f-333a-44e8-bb05-c46b85e4a5b1 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:24.166240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 730/1464] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:26.200896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0f341-f7e3-4168-a903-5c13a40625aa None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:26.201465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0f341-f7e3-4168-a903-5c13a40625aa None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:26.201465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0f341-f7e3-4168-a903-5c13a40625aa None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:26.202882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:26.207985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63320cf9-82de-45bf-92a5-b87728ebdc7a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:26.208424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63320cf9-82de-45bf-92a5-b87728ebdc7a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:26.208580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63320cf9-82de-45bf-92a5-b87728ebdc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:26.225914 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-63320cf9-82de-45bf-92a5-b87728ebdc7a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:26.227113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-63320cf9-82de-45bf-92a5-b87728ebdc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:26.235189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:26.271918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0f341-f7e3-4168-a903-5c13a40625aa None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:26.282543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0f341-f7e3-4168-a903-5c13a40625aa None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:26.286046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12407143-e429-4873-a94f-47f3b60f1431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:26.286680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12407143-e429-4873-a94f-47f3b60f1431 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:26.286962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12407143-e429-4873-a94f-47f3b60f1431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:26.287238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12407143-e429-4873-a94f-47f3b60f1431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:26.296584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12407143-e429-4873-a94f-47f3b60f1431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:26.298009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12407143-e429-4873-a94f-47f3b60f1431 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:26.307846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 736/1467] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:28.360991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e09e1b-34f9-40ff-80d3-42707ca9f4b5 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.361548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e09e1b-34f9-40ff-80d3-42707ca9f4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.361655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e09e1b-34f9-40ff-80d3-42707ca9f4b5 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.362947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:28.368735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccc01-5393-42ce-89e4-76c9b77da4c2 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.369160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccc01-5393-42ce-89e4-76c9b77da4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.369298 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccc01-5393-42ce-89e4-76c9b77da4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.387335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-6a0ccc01-5393-42ce-89e4-76c9b77da4c2 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:28.388565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6a0ccc01-5393-42ce-89e4-76c9b77da4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:28.396736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:28.433246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e09e1b-34f9-40ff-80d3-42707ca9f4b5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:28.443594 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e09e1b-34f9-40ff-80d3-42707ca9f4b5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:28.447623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa01bc-0ab7-4b64-b627-9c83436d9456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:28.448249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa01bc-0ab7-4b64-b627-9c83436d9456 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:28.448555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa01bc-0ab7-4b64-b627-9c83436d9456 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:28.448824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa01bc-0ab7-4b64-b627-9c83436d9456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:28.457474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa01bc-0ab7-4b64-b627-9c83436d9456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:28.458889 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa01bc-0ab7-4b64-b627-9c83436d9456 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:28.468371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 733/1470] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:38.382257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=11 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:38.464340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=14 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:01:48.131410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509942d4-3ffc-4399-bcdd-b27aaddcce5c None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.132053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509942d4-3ffc-4399-bcdd-b27aaddcce5c None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.132053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509942d4-3ffc-4399-bcdd-b27aaddcce5c None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.133379 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 738/1471] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:48.138773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a7895-f699-40e6-b231-4838dfd7a780 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.139180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a7895-f699-40e6-b231-4838dfd7a780 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.139329 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a7895-f699-40e6-b231-4838dfd7a780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.157007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-976a7895-f699-40e6-b231-4838dfd7a780 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:48.158202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-976a7895-f699-40e6-b231-4838dfd7a780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:48.166470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 734/1472] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:48.213231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3efc7a-abc7-474e-a2d2-1d89611ef8f8 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.213523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3efc7a-abc7-474e-a2d2-1d89611ef8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.213805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3efc7a-abc7-474e-a2d2-1d89611ef8f8 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.215153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 739/1473] 10.222.0.13 () {54 vars in 962 bytes} [Mon Jun 20 06:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:48.219933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba26bd-2d94-4197-9d29-d94e6580a738 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.220229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba26bd-2d94-4197-9d29-d94e6580a738 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.220557 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba26bd-2d94-4197-9d29-d94e6580a738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.239523 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a9ba26bd-2d94-4197-9d29-d94e6580a738 None None] MFA Rules not processed for user `80f36041751a446885608f5a3b1f37df`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:48.241391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a9ba26bd-2d94-4197-9d29-d94e6580a738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:48.247959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 735/1474] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Jun 20 06:01:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:48.255168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3efc7a-abc7-474e-a2d2-1d89611ef8f8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:48.265624 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3efc7a-abc7-474e-a2d2-1d89611ef8f8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:48.269124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc8f38-8215-49ab-9de8-213679853036 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f36041751a446885608f5a3b1f37df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:48.269754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc8f38-8215-49ab-9de8-213679853036 service glance] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:48.270039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc8f38-8215-49ab-9de8-213679853036 service glance] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:48.270315 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc8f38-8215-49ab-9de8-213679853036 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:48.279248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc8f38-8215-49ab-9de8-213679853036 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:48.280723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc8f38-8215-49ab-9de8-213679853036 service glance] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:48.290682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 740/1475] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:50.376599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9ffe1-8601-4c8b-9bab-05461822b560 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:50.377166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9ffe1-8601-4c8b-9bab-05461822b560 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:50.377166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9ffe1-8601-4c8b-9bab-05461822b560 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:50.378520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 736/1476] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:50.383765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021d247-d4a6-46ec-8b15-f2c55dae6b01 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:50.384237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021d247-d4a6-46ec-8b15-f2c55dae6b01 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:50.384442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021d247-d4a6-46ec-8b15-f2c55dae6b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:50.402480 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-1021d247-d4a6-46ec-8b15-f2c55dae6b01 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:50.403666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1021d247-d4a6-46ec-8b15-f2c55dae6b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:50.411424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 741/1477] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:50.435806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9ffe1-8601-4c8b-9bab-05461822b560 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:50.448196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9ffe1-8601-4c8b-9bab-05461822b560 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:50.452680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81f557-0441-41a4-b88f-9c06232c8554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:50.453325 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81f557-0441-41a4-b88f-9c06232c8554 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:50.453607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81f557-0441-41a4-b88f-9c06232c8554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:50.453879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81f557-0441-41a4-b88f-9c06232c8554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:50.454603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81f557-0441-41a4-b88f-9c06232c8554 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:50.456353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-0b81f557-0441-41a4-b88f-9c06232c8554 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:01:50.456353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: warnings.warn(msg) Jun 20 06:01:50.456353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: Jun 20 06:01:50.457521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b81f557-0441-41a4-b88f-9c06232c8554 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:50.476546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 737/1478] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jun 20 06:01:50 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:01:52.503511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402606b7-f74a-4afd-afbc-70e187bc4b55 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:52.504037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402606b7-f74a-4afd-afbc-70e187bc4b55 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:52.504037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402606b7-f74a-4afd-afbc-70e187bc4b55 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:52.505397 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 742/1479] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:52.511158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4e19e-4eb4-4298-b912-2bae4fbb05bb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:52.511562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4e19e-4eb4-4298-b912-2bae4fbb05bb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:52.511750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4e19e-4eb4-4298-b912-2bae4fbb05bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:52.529582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-12b4e19e-4eb4-4298-b912-2bae4fbb05bb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:52.530777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-12b4e19e-4eb4-4298-b912-2bae4fbb05bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:52.539071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 738/1480] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:52.581347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402606b7-f74a-4afd-afbc-70e187bc4b55 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:52.595727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402606b7-f74a-4afd-afbc-70e187bc4b55 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:52.601746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c110af-f676-48fa-9f10-daa2a9769d90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:52.602376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c110af-f676-48fa-9f10-daa2a9769d90 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:52.602664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c110af-f676-48fa-9f10-daa2a9769d90 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:52.602945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c110af-f676-48fa-9f10-daa2a9769d90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:52.610984 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c110af-f676-48fa-9f10-daa2a9769d90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:52.612614 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c110af-f676-48fa-9f10-daa2a9769d90 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:52.622452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 743/1481] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:54.809364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edc996-b789-4c21-aed3-34529c2fb056 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:54.809934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edc996-b789-4c21-aed3-34529c2fb056 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:54.809934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edc996-b789-4c21-aed3-34529c2fb056 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:54.811399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 739/1482] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:54.816831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b7c19-326c-4b62-a332-bc45311c2de1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:54.817297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b7c19-326c-4b62-a332-bc45311c2de1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:54.817409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b7c19-326c-4b62-a332-bc45311c2de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:54.835884 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-1b3b7c19-326c-4b62-a332-bc45311c2de1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:54.837102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1b3b7c19-326c-4b62-a332-bc45311c2de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:54.844852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 744/1483] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:54.881047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edc996-b789-4c21-aed3-34529c2fb056 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:54.891655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edc996-b789-4c21-aed3-34529c2fb056 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:54.895162 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af687bc4-f5af-4153-acbb-9bbdc2a64756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:54.895794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af687bc4-f5af-4153-acbb-9bbdc2a64756 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:54.896932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af687bc4-f5af-4153-acbb-9bbdc2a64756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:54.897208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af687bc4-f5af-4153-acbb-9bbdc2a64756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:54.906006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af687bc4-f5af-4153-acbb-9bbdc2a64756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:54.907433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af687bc4-f5af-4153-acbb-9bbdc2a64756 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:54.916849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 740/1484] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:57.010087 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f99628-5b83-486a-9139-3d9b3d8d0648 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:57.010655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f99628-5b83-486a-9139-3d9b3d8d0648 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:57.010655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f99628-5b83-486a-9139-3d9b3d8d0648 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:57.012002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 745/1485] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:57.017098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987674de-c518-4341-9b8f-bbd1377953c9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:57.017497 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987674de-c518-4341-9b8f-bbd1377953c9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:57.017662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987674de-c518-4341-9b8f-bbd1377953c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:57.035690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-987674de-c518-4341-9b8f-bbd1377953c9 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:57.037462 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-987674de-c518-4341-9b8f-bbd1377953c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:57.045234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 741/1486] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:57.083201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f99628-5b83-486a-9139-3d9b3d8d0648 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:57.094896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f99628-5b83-486a-9139-3d9b3d8d0648 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:57.098495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a307f6-d1cd-4a98-a4e4-9b781b81876c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:57.099133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a307f6-d1cd-4a98-a4e4-9b781b81876c service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:57.099435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a307f6-d1cd-4a98-a4e4-9b781b81876c service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:57.099715 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a307f6-d1cd-4a98-a4e4-9b781b81876c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:57.108589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a307f6-d1cd-4a98-a4e4-9b781b81876c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:57.110022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a307f6-d1cd-4a98-a4e4-9b781b81876c service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:57.119355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 746/1487] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:01:59.256440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ba8d-db66-4e44-a79e-fb885f94b9a1 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:59.256985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ba8d-db66-4e44-a79e-fb885f94b9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:59.256985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125ba8d-db66-4e44-a79e-fb885f94b9a1 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:59.258453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 742/1488] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:01:59.263837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c46f8-51b1-44ad-9d49-f4c417bcb312 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:59.264287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c46f8-51b1-44ad-9d49-f4c417bcb312 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:59.264464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c46f8-51b1-44ad-9d49-f4c417bcb312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:59.282884 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-ca5c46f8-51b1-44ad-9d49-f4c417bcb312 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:01:59.284087 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ca5c46f8-51b1-44ad-9d49-f4c417bcb312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:01:59.292646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 747/1489] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:01:59.332996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ba8d-db66-4e44-a79e-fb885f94b9a1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:01:59.344337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125ba8d-db66-4e44-a79e-fb885f94b9a1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:01:59.348071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1251c6-4416-410f-8cf5-718486418438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:01:59.348868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1251c6-4416-410f-8cf5-718486418438 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:01:59.349160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1251c6-4416-410f-8cf5-718486418438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:01:59.349444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1251c6-4416-410f-8cf5-718486418438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:01:59.358637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1251c6-4416-410f-8cf5-718486418438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:01:59.360070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1251c6-4416-410f-8cf5-718486418438 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:01:59.369929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 743/1490] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:02:01.537870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935cb04-ca38-46bf-9d27-59106cbdc52e None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:01.538390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935cb04-ca38-46bf-9d27-59106cbdc52e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:01.538390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935cb04-ca38-46bf-9d27-59106cbdc52e None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:01.539714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 748/1491] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jun 20 06:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:02:01.544984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b1584-613c-47eb-ae04-9f4bac660f06 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:01.545391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b1584-613c-47eb-ae04-9f4bac660f06 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:01.545533 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b1584-613c-47eb-ae04-9f4bac660f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:01.562775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8e1b1584-613c-47eb-ae04-9f4bac660f06 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:02:01.563972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8e1b1584-613c-47eb-ae04-9f4bac660f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:02:01.572260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 744/1492] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jun 20 06:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:02:01.611166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935cb04-ca38-46bf-9d27-59106cbdc52e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:02:01.621961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935cb04-ca38-46bf-9d27-59106cbdc52e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:02:01.625531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33cc1d-12a5-4b0d-951e-c83ee218b9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:02:01.626160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33cc1d-12a5-4b0d-951e-c83ee218b9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:02:01.626442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33cc1d-12a5-4b0d-951e-c83ee218b9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:02:01.626743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33cc1d-12a5-4b0d-951e-c83ee218b9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:02:01.636082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33cc1d-12a5-4b0d-951e-c83ee218b9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:02:01.637551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33cc1d-12a5-4b0d-951e-c83ee218b9a4 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:02:01.647666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 749/1493] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:02:11.557934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=33 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:02:11.642679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=33 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:25.482598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018a6e1-4c64-4736-ba77-2b3076f4eb8e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:25.483160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018a6e1-4c64-4736-ba77-2b3076f4eb8e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:25.483160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018a6e1-4c64-4736-ba77-2b3076f4eb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:25.501664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9018a6e1-4c64-4736-ba77-2b3076f4eb8e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:25.502934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9018a6e1-4c64-4736-ba77-2b3076f4eb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:25.511432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 745/1494] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:25.520511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886a3df-d721-463f-9854-a25b4edbd565 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:25.521021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886a3df-d721-463f-9854-a25b4edbd565 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:25.521127 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886a3df-d721-463f-9854-a25b4edbd565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:25.539166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a886a3df-d721-463f-9854-a25b4edbd565 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:25.540374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a886a3df-d721-463f-9854-a25b4edbd565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:25.548133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 750/1495] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:25.553171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018a6e1-4c64-4736-ba77-2b3076f4eb8e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:25.562680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018a6e1-4c64-4736-ba77-2b3076f4eb8e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:25.567139 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905fa96-3ba7-4a58-97a8-510d9464e576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:25.567778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905fa96-3ba7-4a58-97a8-510d9464e576 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:25.568062 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905fa96-3ba7-4a58-97a8-510d9464e576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:25.568365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905fa96-3ba7-4a58-97a8-510d9464e576 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:25.569099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905fa96-3ba7-4a58-97a8-510d9464e576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:03:25.569429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905fa96-3ba7-4a58-97a8-510d9464e576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:25.570430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-e905fa96-3ba7-4a58-97a8-510d9464e576 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:25.570430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: warnings.warn(msg) Jun 20 06:03:25.570430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: Jun 20 06:03:25.571319 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905fa96-3ba7-4a58-97a8-510d9464e576 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:25.582581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 746/1496] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:03:25.590504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886a3df-d721-463f-9854-a25b4edbd565 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:25.600152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886a3df-d721-463f-9854-a25b4edbd565 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:25.604675 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14d530-64e1-426c-a8eb-19d4849fe2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:25.605311 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14d530-64e1-426c-a8eb-19d4849fe2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:25.605601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14d530-64e1-426c-a8eb-19d4849fe2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:25.605879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14d530-64e1-426c-a8eb-19d4849fe2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:25.606575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14d530-64e1-426c-a8eb-19d4849fe2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:25.608367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: WARNING py.warnings [None req-6d14d530-64e1-426c-a8eb-19d4849fe2e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:25.608367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: warnings.warn(msg) Jun 20 06:03:25.608367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: Jun 20 06:03:25.609571 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14d530-64e1-426c-a8eb-19d4849fe2e4 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:25.645083 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 751/1497] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:03:25 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:03:25.649670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905fa96-3ba7-4a58-97a8-510d9464e576 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:25.660007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905fa96-3ba7-4a58-97a8-510d9464e576 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:25.714257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa18463-c426-4ec0-ae47-7c4e79b5ff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:25.714920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa18463-c426-4ec0-ae47-7c4e79b5ff25 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:25.715204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa18463-c426-4ec0-ae47-7c4e79b5ff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:25.715476 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa18463-c426-4ec0-ae47-7c4e79b5ff25 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:25.716155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa18463-c426-4ec0-ae47-7c4e79b5ff25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:25.717192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-1fa18463-c426-4ec0-ae47-7c4e79b5ff25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:25.717192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: warnings.warn(msg) Jun 20 06:03:25.717192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: Jun 20 06:03:25.718397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa18463-c426-4ec0-ae47-7c4e79b5ff25 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:25.742245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 747/1498] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:03:25 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:03:25.746266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14d530-64e1-426c-a8eb-19d4849fe2e4 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:25.756438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14d530-64e1-426c-a8eb-19d4849fe2e4 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:25.760840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cfae0-568a-4e63-86b4-b677f5660049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:25.761492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cfae0-568a-4e63-86b4-b677f5660049 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:25.761779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cfae0-568a-4e63-86b4-b677f5660049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:25.762058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cfae0-568a-4e63-86b4-b677f5660049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:25.762789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cfae0-568a-4e63-86b4-b677f5660049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:25.763801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: WARNING py.warnings [None req-158cfae0-568a-4e63-86b4-b677f5660049 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:25.763801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: warnings.warn(msg) Jun 20 06:03:25.763801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: Jun 20 06:03:25.764721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158cfae0-568a-4e63-86b4-b677f5660049 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:25.777319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 752/1499] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:03:25.781138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa18463-c426-4ec0-ae47-7c4e79b5ff25 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:25.791445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa18463-c426-4ec0-ae47-7c4e79b5ff25 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:25.795892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390655d-09bd-4164-9320-518095b3b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:25.796572 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390655d-09bd-4164-9320-518095b3b557 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:25.796852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390655d-09bd-4164-9320-518095b3b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:25.797127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390655d-09bd-4164-9320-518095b3b557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:25.797844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390655d-09bd-4164-9320-518095b3b557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:25.798831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-2390655d-09bd-4164-9320-518095b3b557 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:25.798831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: warnings.warn(msg) Jun 20 06:03:25.798831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: Jun 20 06:03:25.799711 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390655d-09bd-4164-9320-518095b3b557 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:25.813498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 748/1500] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:03:25.817281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cfae0-568a-4e63-86b4-b677f5660049 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:25.827140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cfae0-568a-4e63-86b4-b677f5660049 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:25.831630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da45fc-32e3-4427-8e8e-57001f4b2c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:25.832540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da45fc-32e3-4427-8e8e-57001f4b2c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:25.832825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da45fc-32e3-4427-8e8e-57001f4b2c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:25.833104 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da45fc-32e3-4427-8e8e-57001f4b2c5b admin admin] PATH_INFO: `/v3/projects/8dbf1f3d7ff6433f8be03f0240008d53/users/920880d7858c4554ae1a9490549fd057/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:25.847731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da45fc-32e3-4427-8e8e-57001f4b2c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbf1f3d7ff6433f8be03f0240008d53, user_id=920880d7858c4554ae1a9490549fd057, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:25.848790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: WARNING py.warnings [None req-60da45fc-32e3-4427-8e8e-57001f4b2c5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:25.848790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: warnings.warn(msg) Jun 20 06:03:25.848790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: Jun 20 06:03:25.850733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da45fc-32e3-4427-8e8e-57001f4b2c5b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:25.863674 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 753/1501] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:03:25 2022] PUT /identity/v3/projects/8dbf1f3d7ff6433f8be03f0240008d53/users/920880d7858c4554ae1a9490549fd057/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:03:25.875397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70241de-6808-47d4-892e-72546e180257 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:25.875681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70241de-6808-47d4-892e-72546e180257 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:25.875977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70241de-6808-47d4-892e-72546e180257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:25.901510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d70241de-6808-47d4-892e-72546e180257 None None] MFA Rules not processed for user `920880d7858c4554ae1a9490549fd057`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:25.902709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d70241de-6808-47d4-892e-72546e180257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:25.964859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 749/1502] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:03:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:25.978644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c013ba-29da-436f-b0be-ac67ddb1a7e5 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:25.978937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c013ba-29da-436f-b0be-ac67ddb1a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:25.979221 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c013ba-29da-436f-b0be-ac67ddb1a7e5 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:25.980627 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 754/1503] 10.222.0.13 () {54 vars in 963 bytes} [Mon Jun 20 06:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:25.985507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec23921-9bfc-452d-8aa4-db47af27cf2e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:25.985803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec23921-9bfc-452d-8aa4-db47af27cf2e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:25.986083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec23921-9bfc-452d-8aa4-db47af27cf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.003846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-dec23921-9bfc-452d-8aa4-db47af27cf2e None None] MFA Rules not processed for user `e56cc5970ff645e594f50a0a204f44d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:26.004918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dec23921-9bfc-452d-8aa4-db47af27cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:26.048500 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:26.056553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 750/1504] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Jun 20 06:03:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:26.064191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c013ba-29da-436f-b0be-ac67ddb1a7e5 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:26.074570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c013ba-29da-436f-b0be-ac67ddb1a7e5 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:26.078020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebbd3c-2717-4b4b-8499-dcd639fb6aea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:26.078646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebbd3c-2717-4b4b-8499-dcd639fb6aea service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.078931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebbd3c-2717-4b4b-8499-dcd639fb6aea service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.079207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebbd3c-2717-4b4b-8499-dcd639fb6aea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.088033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebbd3c-2717-4b4b-8499-dcd639fb6aea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:26.089494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aebbd3c-2717-4b4b-8499-dcd639fb6aea service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:26.098957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 755/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:26.139545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f746d-c5b1-47f4-9538-dcfc7c7e21ee None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.139844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f746d-c5b1-47f4-9538-dcfc7c7e21ee None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.140124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f746d-c5b1-47f4-9538-dcfc7c7e21ee None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.141502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 751/1506] 10.222.0.13 () {52 vars in 829 bytes} [Mon Jun 20 06:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:03:26.145678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebbd3c-2717-4b4b-8499-dcd639fb6aea service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:26.211584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aebbd3c-2717-4b4b-8499-dcd639fb6aea service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:26.217100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:26.217974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.218257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.218530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] PATH_INFO: `/v3/users/920880d7858c4554ae1a9490549fd057` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.219875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=920880d7858c4554ae1a9490549fd057)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:26.221002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: WARNING py.warnings [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:26.221002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: warnings.warn(msg) Jun 20 06:03:26.221002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: Jun 20 06:03:26.225945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:26.302194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920880d7858c4554ae1a9490549fd057'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:03:26.314429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920880d7858c4554ae1a9490549fd057'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:03:26.315232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920880d7858c4554ae1a9490549fd057'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:03:26.315850 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920880d7858c4554ae1a9490549fd057'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:03:26.333492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920880d7858c4554ae1a9490549fd057'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:03:26.337361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:26.349924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 756/1507] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:03:26 2022] DELETE /identity/v3/users/920880d7858c4554ae1a9490549fd057 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:03:26.354431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3985922-3ccf-4f20-b67f-641ac032cad0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.354725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3985922-3ccf-4f20-b67f-641ac032cad0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.355007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3985922-3ccf-4f20-b67f-641ac032cad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.373811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f3985922-3ccf-4f20-b67f-641ac032cad0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:03:26.375016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f3985922-3ccf-4f20-b67f-641ac032cad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:26.432652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 752/1508] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:03:26.442842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:26.444274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:26.500166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22d1dc-e2c9-4994-9bc6-1715e9c1ebf0 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:26.503808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c311a1a-6787-46fe-b0f2-f56af57c4c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:26.504499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c311a1a-6787-46fe-b0f2-f56af57c4c06 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.504790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c311a1a-6787-46fe-b0f2-f56af57c4c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.505073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c311a1a-6787-46fe-b0f2-f56af57c4c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.513933 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c311a1a-6787-46fe-b0f2-f56af57c4c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:26.515398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c311a1a-6787-46fe-b0f2-f56af57c4c06 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:26.525036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 757/1509] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:03:26.937757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3985922-3ccf-4f20-b67f-641ac032cad0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:03:26.939254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f3985922-3ccf-4f20-b67f-641ac032cad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:03:26.953669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3985922-3ccf-4f20-b67f-641ac032cad0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:03:26.958385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:03:26.959258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:03:26.959543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:03:26.959821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] PATH_INFO: `/v3/projects/8dbf1f3d7ff6433f8be03f0240008d53` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:03:26.961026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dbf1f3d7ff6433f8be03f0240008d53)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:03:26.962047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:26.962047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: warnings.warn(msg) Jun 20 06:03:26.962047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: Jun 20 06:03:26.963257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:03:27.021581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dbf1f3d7ff6433f8be03f0240008d53', 'request_id': 'req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:03:27.027895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dbf1f3d7ff6433f8be03f0240008d53', 'request_id': 'req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:03:27.038861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dbf1f3d7ff6433f8be03f0240008d53', 'request_id': 'req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:03:27.057444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] The token cache is being invalidate because project 8dbf1f3d7ff6433f8be03f0240008d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:03:27.057730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:03:27.058370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8b62bde7-73e0-4e92-8337-db9e8c5f6e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:03:27.059994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 753/1510] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:03:26 2022] DELETE /identity/v3/projects/8dbf1f3d7ff6433f8be03f0240008d53 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:03:36.520720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:37.054378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:10.137851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d108e69-8114-4769-b076-43b7255af27b None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:10.138447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d108e69-8114-4769-b076-43b7255af27b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:10.138447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d108e69-8114-4769-b076-43b7255af27b None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:10.139812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:10.144588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df184c1-a494-4df5-82bc-fcc398b0ca7b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:10.144997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df184c1-a494-4df5-82bc-fcc398b0ca7b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:10.145154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df184c1-a494-4df5-82bc-fcc398b0ca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:10.163400 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4df184c1-a494-4df5-82bc-fcc398b0ca7b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:10.164651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4df184c1-a494-4df5-82bc-fcc398b0ca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:10.223362 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:10.377082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d108e69-8114-4769-b076-43b7255af27b None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:10.378870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7d108e69-8114-4769-b076-43b7255af27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:10.451066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d108e69-8114-4769-b076-43b7255af27b None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:10.456296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf196d-37d5-41a9-8c48-8726817d73ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:10.456950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf196d-37d5-41a9-8c48-8726817d73ce service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:10.457231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf196d-37d5-41a9-8c48-8726817d73ce service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:10.457504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf196d-37d5-41a9-8c48-8726817d73ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:10.465586 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf196d-37d5-41a9-8c48-8726817d73ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:10.467167 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf196d-37d5-41a9-8c48-8726817d73ce service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:10.476893 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 759/1513] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:11.301880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c4844-901e-42a8-a242-1b4d4350ef0a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:11.302397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c4844-901e-42a8-a242-1b4d4350ef0a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:11.302501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c4844-901e-42a8-a242-1b4d4350ef0a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:11.303810 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:11.308591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ec11-21c4-464e-aefd-59bc76b339b8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:11.309046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ec11-21c4-464e-aefd-59bc76b339b8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:11.309144 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ec11-21c4-464e-aefd-59bc76b339b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:11.328100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-9de9ec11-21c4-464e-aefd-59bc76b339b8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:11.329901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9de9ec11-21c4-464e-aefd-59bc76b339b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:11.337543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:11.487512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c4844-901e-42a8-a242-1b4d4350ef0a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:11.502271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c4844-901e-42a8-a242-1b4d4350ef0a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:11.507610 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcfcbf-9f5a-4407-baa2-7353d1f439b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:11.508239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcfcbf-9f5a-4407-baa2-7353d1f439b9 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:11.508550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcfcbf-9f5a-4407-baa2-7353d1f439b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:11.508828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcfcbf-9f5a-4407-baa2-7353d1f439b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:11.516847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcfcbf-9f5a-4407-baa2-7353d1f439b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:11.518457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcfcbf-9f5a-4407-baa2-7353d1f439b9 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:11.527985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 756/1516] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:12.002133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824469d-5132-4b9f-924d-2ea30d02511f None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:12.002425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824469d-5132-4b9f-924d-2ea30d02511f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:12.002705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824469d-5132-4b9f-924d-2ea30d02511f None None] PATH_INFO: `/v3` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:12.004033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 761/1517] 10.222.0.36 () {54 vars in 925 bytes} [Mon Jun 20 06:05:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:05:12.010152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f55cd6-63ad-404c-974b-6010013d5dea None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:12.010470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f55cd6-63ad-404c-974b-6010013d5dea None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:12.010775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f55cd6-63ad-404c-974b-6010013d5dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:12.028853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-08f55cd6-63ad-404c-974b-6010013d5dea None None] MFA Rules not processed for user `0a5e0b53aafc4bf3a23a7882ed12a89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:12.030076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-08f55cd6-63ad-404c-974b-6010013d5dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:12.091169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 757/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jun 20 06:05:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:05:21.094258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304d2c-9413-4bac-825e-6eadbf2cb726 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:21.094813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304d2c-9413-4bac-825e-6eadbf2cb726 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:21.094813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304d2c-9413-4bac-825e-6eadbf2cb726 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:21.096151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 762/1519] 10.222.0.13 () {54 vars in 960 bytes} [Mon Jun 20 06:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:21.101314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2822c-1bce-40bb-8820-e14fe65be631 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:21.101819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2822c-1bce-40bb-8820-e14fe65be631 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:21.101928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2822c-1bce-40bb-8820-e14fe65be631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:21.120125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c7d2822c-1bce-40bb-8820-e14fe65be631 None None] MFA Rules not processed for user `0a5e0b53aafc4bf3a23a7882ed12a89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:21.121358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c7d2822c-1bce-40bb-8820-e14fe65be631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:21.130732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 758/1520] 10.222.0.13 () {58 vars in 1057 bytes} [Mon Jun 20 06:05:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:21.138056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304d2c-9413-4bac-825e-6eadbf2cb726 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:21.151584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304d2c-9413-4bac-825e-6eadbf2cb726 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:21.156478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170a961-0c65-4601-b46a-ce9923a36034 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e0b53aafc4bf3a23a7882ed12a89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:21.157097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a961-0c65-4601-b46a-ce9923a36034 service placement] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:21.157381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a961-0c65-4601-b46a-ce9923a36034 service placement] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:21.157655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a961-0c65-4601-b46a-ce9923a36034 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:21.165722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170a961-0c65-4601-b46a-ce9923a36034 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:21.167334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170a961-0c65-4601-b46a-ce9923a36034 service placement] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:21.177233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 763/1521] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:22.781646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5493-00fb-437b-b8d9-f1bb838e26cc None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:22.782228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5493-00fb-437b-b8d9-f1bb838e26cc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:22.782228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c5493-00fb-437b-b8d9-f1bb838e26cc None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:22.784216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:22.789077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3530d9-0251-4c4b-8890-a00c61dcb261 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:22.789506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3530d9-0251-4c4b-8890-a00c61dcb261 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:22.789649 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3530d9-0251-4c4b-8890-a00c61dcb261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:22.807218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8c3530d9-0251-4c4b-8890-a00c61dcb261 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:22.808444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8c3530d9-0251-4c4b-8890-a00c61dcb261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:22.816138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:22.968965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5493-00fb-437b-b8d9-f1bb838e26cc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:22.983664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c5493-00fb-437b-b8d9-f1bb838e26cc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:22.989927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660ed31-52d4-464f-809d-3a0a6db09296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:22.990565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ed31-52d4-464f-809d-3a0a6db09296 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:22.990845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ed31-52d4-464f-809d-3a0a6db09296 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:22.991118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ed31-52d4-464f-809d-3a0a6db09296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:22.999262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660ed31-52d4-464f-809d-3a0a6db09296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:23.001224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660ed31-52d4-464f-809d-3a0a6db09296 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:23.010697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 760/1524] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:23.828726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d77b38-1ad1-4292-b5d0-67268d6e04a5 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:23.829292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d77b38-1ad1-4292-b5d0-67268d6e04a5 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:23.829292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d77b38-1ad1-4292-b5d0-67268d6e04a5 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:23.830672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 06:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:23.835375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d34de-abcb-45ab-baea-0629512bd745 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:23.835788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d34de-abcb-45ab-baea-0629512bd745 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:23.835935 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d34de-abcb-45ab-baea-0629512bd745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:23.853951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-104d34de-abcb-45ab-baea-0629512bd745 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:23.855134 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-104d34de-abcb-45ab-baea-0629512bd745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:23.863476 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 06:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:24.017251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d77b38-1ad1-4292-b5d0-67268d6e04a5 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:24.031636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d77b38-1ad1-4292-b5d0-67268d6e04a5 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:24.037527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5423dec-67be-4749-8cfe-dc111a9f469e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:24.038155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5423dec-67be-4749-8cfe-dc111a9f469e service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:24.038440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5423dec-67be-4749-8cfe-dc111a9f469e service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:24.038716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5423dec-67be-4749-8cfe-dc111a9f469e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:24.046695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5423dec-67be-4749-8cfe-dc111a9f469e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:24.048277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5423dec-67be-4749-8cfe-dc111a9f469e service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:24.058191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 766/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:28.024670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c1c65-ddc8-493a-8954-d48619b2bd32 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:28.025321 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c1c65-ddc8-493a-8954-d48619b2bd32 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:28.025321 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c1c65-ddc8-493a-8954-d48619b2bd32 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:28.026929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:28.032038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3322-3477-4b1f-aa18-c796b9b8d3ee None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:28.032470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3322-3477-4b1f-aa18-c796b9b8d3ee None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:28.032637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a3322-3477-4b1f-aa18-c796b9b8d3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:28.050777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-160a3322-3477-4b1f-aa18-c796b9b8d3ee None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:28.051977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-160a3322-3477-4b1f-aa18-c796b9b8d3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:28.059926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:28.097056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c1c65-ddc8-493a-8954-d48619b2bd32 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:28.098794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-314c1c65-ddc8-493a-8954-d48619b2bd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:28.154930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c1c65-ddc8-493a-8954-d48619b2bd32 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:28.159122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6cb18-0bd0-4e6a-bea2-e261749beac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:28.159754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6cb18-0bd0-4e6a-bea2-e261749beac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:28.160042 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6cb18-0bd0-4e6a-bea2-e261749beac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:28.160334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6cb18-0bd0-4e6a-bea2-e261749beac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:28.169984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6cb18-0bd0-4e6a-bea2-e261749beac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:28.171412 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6cb18-0bd0-4e6a-bea2-e261749beac2 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:28.176257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:28.181291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 763/1530] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:30.206915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d6fb-005a-41b9-a080-94ba042a32c7 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:30.207495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d6fb-005a-41b9-a080-94ba042a32c7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:30.207495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d6fb-005a-41b9-a080-94ba042a32c7 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:30.208858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:30.214055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e970908-72e9-450e-bd5c-51db29ec57ab None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:30.214462 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e970908-72e9-450e-bd5c-51db29ec57ab None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:30.214614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e970908-72e9-450e-bd5c-51db29ec57ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:30.234636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3e970908-72e9-450e-bd5c-51db29ec57ab None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:30.235839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3e970908-72e9-450e-bd5c-51db29ec57ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:30.243671 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:30.279823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d6fb-005a-41b9-a080-94ba042a32c7 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:30.291117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d6fb-005a-41b9-a080-94ba042a32c7 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:30.294609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e10b2-2987-4039-8feb-a620827dd5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:30.295232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e10b2-2987-4039-8feb-a620827dd5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:30.295514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e10b2-2987-4039-8feb-a620827dd5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:30.295790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e10b2-2987-4039-8feb-a620827dd5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:30.304701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e10b2-2987-4039-8feb-a620827dd5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:30.306142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e10b2-2987-4039-8feb-a620827dd5c7 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:30.315481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 769/1533] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:33.871916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcc29f-c4a5-46c3-aa68-06ea32e5b176 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:33.872498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcc29f-c4a5-46c3-aa68-06ea32e5b176 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:33.872498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcc29f-c4a5-46c3-aa68-06ea32e5b176 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:33.873867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:33.879705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b6537-1496-49b3-ac0c-8fd21ffd9ca1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:33.880190 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b6537-1496-49b3-ac0c-8fd21ffd9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:33.880291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b6537-1496-49b3-ac0c-8fd21ffd9ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:33.898080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-224b6537-1496-49b3-ac0c-8fd21ffd9ca1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:33.899260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-224b6537-1496-49b3-ac0c-8fd21ffd9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:33.907038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:34.213741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcc29f-c4a5-46c3-aa68-06ea32e5b176 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:34.215400 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-edbcc29f-c4a5-46c3-aa68-06ea32e5b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:34.272598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcc29f-c4a5-46c3-aa68-06ea32e5b176 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:34.276096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e491a-e675-4a9d-bcd4-a2a72243f7ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:34.276773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e491a-e675-4a9d-bcd4-a2a72243f7ee service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:34.277069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e491a-e675-4a9d-bcd4-a2a72243f7ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:34.277346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e491a-e675-4a9d-bcd4-a2a72243f7ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:34.286629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e491a-e675-4a9d-bcd4-a2a72243f7ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:34.288055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e491a-e675-4a9d-bcd4-a2a72243f7ee service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:34.297409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 766/1536] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:36.352539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c0fb8-0b44-4a05-99e3-7d5d436407f3 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:36.353098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c0fb8-0b44-4a05-99e3-7d5d436407f3 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:36.353098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c0fb8-0b44-4a05-99e3-7d5d436407f3 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:36.354478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 06:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:05:36.359769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b59a0e-77eb-4bc3-a66c-8b750b4594da None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:36.360184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b59a0e-77eb-4bc3-a66c-8b750b4594da None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:36.360343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b59a0e-77eb-4bc3-a66c-8b750b4594da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:36.377927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-00b59a0e-77eb-4bc3-a66c-8b750b4594da None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:05:36.379114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-00b59a0e-77eb-4bc3-a66c-8b750b4594da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:36.386827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 06:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:05:36.688726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c0fb8-0b44-4a05-99e3-7d5d436407f3 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:05:36.690912 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3b0c0fb8-0b44-4a05-99e3-7d5d436407f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:05:36.698532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=65 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:36.707401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c0fb8-0b44-4a05-99e3-7d5d436407f3 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:05:36.710990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b1621-b99b-4885-b04e-cb470c491d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:05:36.711629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b1621-b99b-4885-b04e-cb470c491d0d service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:05:36.711917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b1621-b99b-4885-b04e-cb470c491d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:05:36.712195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b1621-b99b-4885-b04e-cb470c491d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:05:36.721859 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b1621-b99b-4885-b04e-cb470c491d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:05:36.723289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b1621-b99b-4885-b04e-cb470c491d0d service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:05:36.732700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 772/1539] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:05:46.372767 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=32 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:46.728503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:08.895779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da93e-e6e0-4f4a-8686-7888306320e9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:08.896749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da93e-e6e0-4f4a-8686-7888306320e9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:08.896749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da93e-e6e0-4f4a-8686-7888306320e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:08.921323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-724da93e-e6e0-4f4a-8686-7888306320e9 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:08.922539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-724da93e-e6e0-4f4a-8686-7888306320e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:08.931143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 768/1540] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:08.941494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e955e-e195-44d9-b71a-67276b2d1590 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:08.942511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e955e-e195-44d9-b71a-67276b2d1590 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:08.943028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e955e-e195-44d9-b71a-67276b2d1590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:08.949621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73c26-9e2e-4d95-8a1e-83d50458cff4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:08.949909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73c26-9e2e-4d95-8a1e-83d50458cff4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:08.950185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e73c26-9e2e-4d95-8a1e-83d50458cff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:08.974874 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-33e73c26-9e2e-4d95-8a1e-83d50458cff4 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:08.975875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-473e955e-e195-44d9-b71a-67276b2d1590 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:08.976081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-33e73c26-9e2e-4d95-8a1e-83d50458cff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:08.977518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-473e955e-e195-44d9-b71a-67276b2d1590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:08.992452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 773/1541] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:08.993285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 769/1542] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:08.994313 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0013997-47db-43ba-90b9-e1eb76550124 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:08.994835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0013997-47db-43ba-90b9-e1eb76550124 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:08.995336 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0013997-47db-43ba-90b9-e1eb76550124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:08.998470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e73c26-9e2e-4d95-8a1e-83d50458cff4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.018779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e73c26-9e2e-4d95-8a1e-83d50458cff4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.032909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b226af-d1ae-49ad-9947-d753e0701639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.033583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b226af-d1ae-49ad-9947-d753e0701639 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.033865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b226af-d1ae-49ad-9947-d753e0701639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.034140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b226af-d1ae-49ad-9947-d753e0701639 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.034637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b0013997-47db-43ba-90b9-e1eb76550124 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.034876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b226af-d1ae-49ad-9947-d753e0701639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:09.035187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b226af-d1ae-49ad-9947-d753e0701639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.036518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b0013997-47db-43ba-90b9-e1eb76550124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.036870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b226af-d1ae-49ad-9947-d753e0701639 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.057381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 774/1543] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.061597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 770/1544] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:09.063438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8f3ad-dc9b-4157-bea7-4f51363eed1e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.063729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8f3ad-dc9b-4157-bea7-4f51363eed1e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.064008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8f3ad-dc9b-4157-bea7-4f51363eed1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.065759 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f8b1-f115-4125-bcf1-8877dda86043 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.066042 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f8b1-f115-4125-bcf1-8877dda86043 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.066321 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9f8b1-f115-4125-bcf1-8877dda86043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.090820 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-5fe8f3ad-dc9b-4157-bea7-4f51363eed1e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.092723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5fe8f3ad-dc9b-4157-bea7-4f51363eed1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.099333 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-00f9f8b1-f115-4125-bcf1-8877dda86043 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.100617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-00f9f8b1-f115-4125-bcf1-8877dda86043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.111758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 775/1545] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.113137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21077837-36b2-4160-8b95-d1cca8e8e5c7 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.113431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21077837-36b2-4160-8b95-d1cca8e8e5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.113712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21077837-36b2-4160-8b95-d1cca8e8e5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.120980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 771/1546] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.121827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f8b1-f115-4125-bcf1-8877dda86043 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.136218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9f8b1-f115-4125-bcf1-8877dda86043 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.141990 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e239e-b9a5-4ef1-8dff-008ca3207dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.142660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e239e-b9a5-4ef1-8dff-008ca3207dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.142944 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e239e-b9a5-4ef1-8dff-008ca3207dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.143225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e239e-b9a5-4ef1-8dff-008ca3207dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.144033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e239e-b9a5-4ef1-8dff-008ca3207dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.144734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-21077837-36b2-4160-8b95-d1cca8e8e5c7 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.145111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-ed1e239e-b9a5-4ef1-8dff-008ca3207dd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:09.145111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: warnings.warn(msg) Jun 20 06:07:09.145111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: Jun 20 06:07:09.145987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-21077837-36b2-4160-8b95-d1cca8e8e5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.146583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e239e-b9a5-4ef1-8dff-008ca3207dd9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.166878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 776/1547] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.166878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb7d75-6eee-4f67-8c7a-81f431aca3c9 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.166878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb7d75-6eee-4f67-8c7a-81f431aca3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.166878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb7d75-6eee-4f67-8c7a-81f431aca3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.183526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 772/1548] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:09.184832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e239e-b9a5-4ef1-8dff-008ca3207dd9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.191560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-dbbb7d75-6eee-4f67-8c7a-81f431aca3c9 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.192400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-dbbb7d75-6eee-4f67-8c7a-81f431aca3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.257028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e239e-b9a5-4ef1-8dff-008ca3207dd9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.261529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01401528-88ae-4956-9e8c-7847c60ad381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.262181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01401528-88ae-4956-9e8c-7847c60ad381 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.262461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01401528-88ae-4956-9e8c-7847c60ad381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.262734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01401528-88ae-4956-9e8c-7847c60ad381 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.263505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01401528-88ae-4956-9e8c-7847c60ad381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:09.263811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01401528-88ae-4956-9e8c-7847c60ad381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.265143 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 777/1549] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.265437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01401528-88ae-4956-9e8c-7847c60ad381 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.266492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f91a2-2e68-4502-82dc-27b9cb486094 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.267065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f91a2-2e68-4502-82dc-27b9cb486094 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.267354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f91a2-2e68-4502-82dc-27b9cb486094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.281010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 773/1550] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:09.281010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7f28-d1d7-4744-bdcd-6f8966d545fa None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.281010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7f28-d1d7-4744-bdcd-6f8966d545fa None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.281010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c7f28-d1d7-4744-bdcd-6f8966d545fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.291966 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-6e9f91a2-2e68-4502-82dc-27b9cb486094 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.293221 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6e9f91a2-2e68-4502-82dc-27b9cb486094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.300217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-966c7f28-d1d7-4744-bdcd-6f8966d545fa None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.301412 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-966c7f28-d1d7-4744-bdcd-6f8966d545fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.302058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 778/1551] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.302843 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f91a2-2e68-4502-82dc-27b9cb486094 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.312286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f91a2-2e68-4502-82dc-27b9cb486094 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.313013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 774/1552] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.313781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c7f28-d1d7-4744-bdcd-6f8966d545fa None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.323195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb3cc7-8838-4ec0-9293-dfb9c431e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.323850 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb3cc7-8838-4ec0-9293-dfb9c431e56d admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.324137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb3cc7-8838-4ec0-9293-dfb9c431e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.324466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb3cc7-8838-4ec0-9293-dfb9c431e56d admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.325199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb3cc7-8838-4ec0-9293-dfb9c431e56d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:09.325511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb3cc7-8838-4ec0-9293-dfb9c431e56d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.326595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: WARNING py.warnings [None req-d7eb3cc7-8838-4ec0-9293-dfb9c431e56d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:09.326595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: warnings.warn(msg) Jun 20 06:07:09.326595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: Jun 20 06:07:09.327505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb3cc7-8838-4ec0-9293-dfb9c431e56d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.329581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c7f28-d1d7-4744-bdcd-6f8966d545fa None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.334155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dd20c-17a9-4543-bb4c-54a743463a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.334832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd20c-17a9-4543-bb4c-54a743463a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.335111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd20c-17a9-4543-bb4c-54a743463a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.335385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd20c-17a9-4543-bb4c-54a743463a48 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.336061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dd20c-17a9-4543-bb4c-54a743463a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.338052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dd20c-17a9-4543-bb4c-54a743463a48 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.339565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 779/1553] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:09.340810 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bedda-24e9-4749-b1bc-c32e8c5aee20 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.341102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bedda-24e9-4749-b1bc-c32e8c5aee20 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.341381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bedda-24e9-4749-b1bc-c32e8c5aee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.361693 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-0e9bedda-24e9-4749-b1bc-c32e8c5aee20 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.362297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 775/1554] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:09.362897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0e9bedda-24e9-4749-b1bc-c32e8c5aee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.363745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3a95f-50c6-4c54-b612-c98000c8c8a0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.363973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3a95f-50c6-4c54-b612-c98000c8c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.364253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3a95f-50c6-4c54-b612-c98000c8c8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.371594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 780/1555] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.372871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8448993-317f-4b00-a036-bc37a5f86319 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.373169 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8448993-317f-4b00-a036-bc37a5f86319 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.373450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8448993-317f-4b00-a036-bc37a5f86319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.385598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4bc3a95f-50c6-4c54-b612-c98000c8c8a0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.386881 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4bc3a95f-50c6-4c54-b612-c98000c8c8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.393085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-e8448993-317f-4b00-a036-bc37a5f86319 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.394260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e8448993-317f-4b00-a036-bc37a5f86319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.394889 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 776/1556] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.395650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3a95f-50c6-4c54-b612-c98000c8c8a0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.408365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 781/1557] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.409141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8448993-317f-4b00-a036-bc37a5f86319 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.410616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3a95f-50c6-4c54-b612-c98000c8c8a0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.415334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dabacb-6588-41f4-bed6-0f2a363fdb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.416035 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dabacb-6588-41f4-bed6-0f2a363fdb0c admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.416332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dabacb-6588-41f4-bed6-0f2a363fdb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.416625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dabacb-6588-41f4-bed6-0f2a363fdb0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.417339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dabacb-6588-41f4-bed6-0f2a363fdb0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.418551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8448993-317f-4b00-a036-bc37a5f86319 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.419279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dabacb-6588-41f4-bed6-0f2a363fdb0c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.423605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849d02b-db45-4460-9002-4a99d66aa542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.424242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849d02b-db45-4460-9002-4a99d66aa542 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.424563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849d02b-db45-4460-9002-4a99d66aa542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.424844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849d02b-db45-4460-9002-4a99d66aa542 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.425577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849d02b-db45-4460-9002-4a99d66aa542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:09.425891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849d02b-db45-4460-9002-4a99d66aa542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.427488 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849d02b-db45-4460-9002-4a99d66aa542 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.439892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 782/1558] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:09.445705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecde9e4-c755-41d0-90d2-dcac9abb8881 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.446290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecde9e4-c755-41d0-90d2-dcac9abb8881 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.446430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 777/1559] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:09.446840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecde9e4-c755-41d0-90d2-dcac9abb8881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.447135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dabacb-6588-41f4-bed6-0f2a363fdb0c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.465219 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4ecde9e4-c755-41d0-90d2-dcac9abb8881 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.466423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4ecde9e4-c755-41d0-90d2-dcac9abb8881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.496200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:09.511555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dabacb-6588-41f4-bed6-0f2a363fdb0c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.517250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505fe24-b36a-4e18-adb4-2780fe16868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.517917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fe24-b36a-4e18-adb4-2780fe16868e admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.518204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fe24-b36a-4e18-adb4-2780fe16868e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.518490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fe24-b36a-4e18-adb4-2780fe16868e admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.519198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505fe24-b36a-4e18-adb4-2780fe16868e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.521457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505fe24-b36a-4e18-adb4-2780fe16868e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.527081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 783/1560] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.528145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecde9e4-c755-41d0-90d2-dcac9abb8881 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.537474 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecde9e4-c755-41d0-90d2-dcac9abb8881 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.542544 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66452952-08c9-40a0-b5f9-7c9a91e14e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.543301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452952-08c9-40a0-b5f9-7c9a91e14e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.543592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452952-08c9-40a0-b5f9-7c9a91e14e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.543868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66452952-08c9-40a0-b5f9-7c9a91e14e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.545231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66452952-08c9-40a0-b5f9-7c9a91e14e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.546838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66452952-08c9-40a0-b5f9-7c9a91e14e96 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.552709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 778/1561] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:09.553968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228608ab-f34b-4ebe-8618-ff7db8cbfb6f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.554260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228608ab-f34b-4ebe-8618-ff7db8cbfb6f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.554538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228608ab-f34b-4ebe-8618-ff7db8cbfb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.559923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 784/1562] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:09.561546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e3df-8204-4ae4-b0a9-b6e8b851ff39 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.561840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e3df-8204-4ae4-b0a9-b6e8b851ff39 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.562123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e3df-8204-4ae4-b0a9-b6e8b851ff39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.574986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-228608ab-f34b-4ebe-8618-ff7db8cbfb6f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.576765 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-228608ab-f34b-4ebe-8618-ff7db8cbfb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.580686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-3e86e3df-8204-4ae4-b0a9-b6e8b851ff39 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:09.581858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3e86e3df-8204-4ae4-b0a9-b6e8b851ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:09.594498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:09.635978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 779/1563] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.636975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228608ab-f34b-4ebe-8618-ff7db8cbfb6f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.645982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228608ab-f34b-4ebe-8618-ff7db8cbfb6f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.648062 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 785/1564] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:09.648923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86e3df-8204-4ae4-b0a9-b6e8b851ff39 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.654198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e15a3-c644-4e29-ab8b-d30c4d96d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.654846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e15a3-c644-4e29-ab8b-d30c4d96d457 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.655126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e15a3-c644-4e29-ab8b-d30c4d96d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.655398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e15a3-c644-4e29-ab8b-d30c4d96d457 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.656120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e15a3-c644-4e29-ab8b-d30c4d96d457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:09.656468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e15a3-c644-4e29-ab8b-d30c4d96d457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.658080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e15a3-c644-4e29-ab8b-d30c4d96d457 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.658298 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86e3df-8204-4ae4-b0a9-b6e8b851ff39 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.662821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef75e3-a147-453e-9b2b-b54870e90684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.663395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef75e3-a147-453e-9b2b-b54870e90684 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.663679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef75e3-a147-453e-9b2b-b54870e90684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.663955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef75e3-a147-453e-9b2b-b54870e90684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.664681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef75e3-a147-453e-9b2b-b54870e90684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.666559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef75e3-a147-453e-9b2b-b54870e90684 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.670470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 780/1565] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:09.671323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e15a3-c644-4e29-ab8b-d30c4d96d457 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.681960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e15a3-c644-4e29-ab8b-d30c4d96d457 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.687920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f24df-417b-4c25-8dc4-dc2ef69f4437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.688599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f24df-417b-4c25-8dc4-dc2ef69f4437 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.688884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f24df-417b-4c25-8dc4-dc2ef69f4437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.689156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f24df-417b-4c25-8dc4-dc2ef69f4437 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.689828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f24df-417b-4c25-8dc4-dc2ef69f4437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.691729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f24df-417b-4c25-8dc4-dc2ef69f4437 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.695513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 786/1566] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:09.695513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef75e3-a147-453e-9b2b-b54870e90684 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.717340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 781/1567] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/users => generated 284 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:09.721200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f24df-417b-4c25-8dc4-dc2ef69f4437 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.730402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f24df-417b-4c25-8dc4-dc2ef69f4437 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.769626 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef75e3-a147-453e-9b2b-b54870e90684 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.774886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ca81e-75cb-4695-9b13-5e62090711d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.775677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca81e-75cb-4695-9b13-5e62090711d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.775965 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca81e-75cb-4695-9b13-5e62090711d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.776246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca81e-75cb-4695-9b13-5e62090711d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.777007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ca81e-75cb-4695-9b13-5e62090711d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:09.777320 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ca81e-75cb-4695-9b13-5e62090711d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.778948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ca81e-75cb-4695-9b13-5e62090711d4 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.789461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407b924-ef0c-49ea-8d66-aba679488d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.790157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 787/1568] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:09.790293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407b924-ef0c-49ea-8d66-aba679488d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.790448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407b924-ef0c-49ea-8d66-aba679488d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.790726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407b924-ef0c-49ea-8d66-aba679488d8e admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.791013 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ca81e-75cb-4695-9b13-5e62090711d4 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.791420 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407b924-ef0c-49ea-8d66-aba679488d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.793372 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407b924-ef0c-49ea-8d66-aba679488d8e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.807786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ca81e-75cb-4695-9b13-5e62090711d4 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.813503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7901a-e981-4716-82f4-28a5565e4a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.814154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7901a-e981-4716-82f4-28a5565e4a0a admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.814438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7901a-e981-4716-82f4-28a5565e4a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.814720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7901a-e981-4716-82f4-28a5565e4a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.815415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 782/1569] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:09.815653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7901a-e981-4716-82f4-28a5565e4a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.816643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407b924-ef0c-49ea-8d66-aba679488d8e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.817453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7901a-e981-4716-82f4-28a5565e4a0a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.829754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 788/1570] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:09.829931 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407b924-ef0c-49ea-8d66-aba679488d8e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.830030 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7901a-e981-4716-82f4-28a5565e4a0a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.833561 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb61f6-bae5-456d-8498-0584ebeb0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.834205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb61f6-bae5-456d-8498-0584ebeb0a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.834487 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb61f6-bae5-456d-8498-0584ebeb0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.834758 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb61f6-bae5-456d-8498-0584ebeb0a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.835475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb61f6-bae5-456d-8498-0584ebeb0a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:09.836188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb61f6-bae5-456d-8498-0584ebeb0a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.837422 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb61f6-bae5-456d-8498-0584ebeb0a38 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.839614 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7901a-e981-4716-82f4-28a5565e4a0a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.844738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c3df5-7893-4a27-ae12-cde16b945418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.845373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c3df5-7893-4a27-ae12-cde16b945418 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.845663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c3df5-7893-4a27-ae12-cde16b945418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.845942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c3df5-7893-4a27-ae12-cde16b945418 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.846807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c3df5-7893-4a27-ae12-cde16b945418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:09.847127 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c3df5-7893-4a27-ae12-cde16b945418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.848755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c3df5-7893-4a27-ae12-cde16b945418 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.850913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 783/1571] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:09.851779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb61f6-bae5-456d-8498-0584ebeb0a38 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.866058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 789/1572] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:09.866058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c3df5-7893-4a27-ae12-cde16b945418 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.866333 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb61f6-bae5-456d-8498-0584ebeb0a38 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.870613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767f7de-44d4-4fa3-882c-f3b7756e0fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.871252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f7de-44d4-4fa3-882c-f3b7756e0fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.871534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f7de-44d4-4fa3-882c-f3b7756e0fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.871805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f7de-44d4-4fa3-882c-f3b7756e0fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.872611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767f7de-44d4-4fa3-882c-f3b7756e0fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.872714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c3df5-7893-4a27-ae12-cde16b945418 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.874576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767f7de-44d4-4fa3-882c-f3b7756e0fb5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.877265 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf0fc-651f-45f6-ba7d-78f83b982cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.877901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf0fc-651f-45f6-ba7d-78f83b982cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.878190 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf0fc-651f-45f6-ba7d-78f83b982cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.878473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf0fc-651f-45f6-ba7d-78f83b982cbf admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.879147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daf0fc-651f-45f6-ba7d-78f83b982cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.880181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: WARNING py.warnings [None req-c4daf0fc-651f-45f6-ba7d-78f83b982cbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:09.880181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: warnings.warn(msg) Jun 20 06:07:09.880181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: Jun 20 06:07:09.881416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daf0fc-651f-45f6-ba7d-78f83b982cbf admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.889823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:09.901902 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 784/1573] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:09.902660 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 790/1574] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:09.902798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767f7de-44d4-4fa3-882c-f3b7756e0fb5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.903459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf0fc-651f-45f6-ba7d-78f83b982cbf admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.914505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf0fc-651f-45f6-ba7d-78f83b982cbf admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.958174 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:09.965485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767f7de-44d4-4fa3-882c-f3b7756e0fb5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:09.970607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc2701-9ebe-42ea-82a5-f3032a5799db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.971292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc2701-9ebe-42ea-82a5-f3032a5799db admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.971575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc2701-9ebe-42ea-82a5-f3032a5799db admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.971844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc2701-9ebe-42ea-82a5-f3032a5799db admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.972393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa613-0124-4a0b-bd4f-b7700683879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:09.972612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc2701-9ebe-42ea-82a5-f3032a5799db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.973061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa613-0124-4a0b-bd4f-b7700683879d admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:09.973354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa613-0124-4a0b-bd4f-b7700683879d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:09.973636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daa613-0124-4a0b-bd4f-b7700683879d admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:09.974209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc2701-9ebe-42ea-82a5-f3032a5799db admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.974323 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daa613-0124-4a0b-bd4f-b7700683879d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:09.976230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daa613-0124-4a0b-bd4f-b7700683879d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:09.985302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 785/1575] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:09.986112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc2701-9ebe-42ea-82a5-f3032a5799db admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:09.995953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc2701-9ebe-42ea-82a5-f3032a5799db admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.001142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddffa0-a2dc-49e8-8d87-139fba1f83f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.001788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddffa0-a2dc-49e8-8d87-139fba1f83f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.002071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddffa0-a2dc-49e8-8d87-139fba1f83f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.002347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddffa0-a2dc-49e8-8d87-139fba1f83f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.002796 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 791/1576] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:09 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:10.003067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddffa0-a2dc-49e8-8d87-139fba1f83f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.003594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa613-0124-4a0b-bd4f-b7700683879d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.004692 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddffa0-a2dc-49e8-8d87-139fba1f83f0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.014980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 786/1577] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.015622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddffa0-a2dc-49e8-8d87-139fba1f83f0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.026074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddffa0-a2dc-49e8-8d87-139fba1f83f0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.069102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daa613-0124-4a0b-bd4f-b7700683879d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.074147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eed06-a63f-4878-92a5-2eed72b6d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.075035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eed06-a63f-4878-92a5-2eed72b6d942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.075316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eed06-a63f-4878-92a5-2eed72b6d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.075591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eed06-a63f-4878-92a5-2eed72b6d942 admin admin] PATH_INFO: `/v3/projects/0bf36fa447dd4c1e937913c9b8fa3e72/users/9c16c704d1b74ae5b2b7d60cea60606d/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.083186 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dc878-1504-4f44-8dc7-9f29b00aa1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.083883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc878-1504-4f44-8dc7-9f29b00aa1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.084169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc878-1504-4f44-8dc7-9f29b00aa1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.084468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc878-1504-4f44-8dc7-9f29b00aa1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.085153 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846dc878-1504-4f44-8dc7-9f29b00aa1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.087081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846dc878-1504-4f44-8dc7-9f29b00aa1a4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.090262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eed06-a63f-4878-92a5-2eed72b6d942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf36fa447dd4c1e937913c9b8fa3e72, user_id=9c16c704d1b74ae5b2b7d60cea60606d, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.092984 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eed06-a63f-4878-92a5-2eed72b6d942 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.106119 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 792/1578] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:10 2022] PUT /identity/v3/projects/0bf36fa447dd4c1e937913c9b8fa3e72/users/9c16c704d1b74ae5b2b7d60cea60606d/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:10.113121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 787/1579] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:10 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:10.116922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dc878-1504-4f44-8dc7-9f29b00aa1a4 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.117072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eed06-a63f-4878-92a5-2eed72b6d942 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.177487 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dc878-1504-4f44-8dc7-9f29b00aa1a4 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.180113 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eed06-a63f-4878-92a5-2eed72b6d942 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.181968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb80a0-b7a4-4ae8-89a1-f4c268d41201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.182868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb80a0-b7a4-4ae8-89a1-f4c268d41201 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.183188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb80a0-b7a4-4ae8-89a1-f4c268d41201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.183478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb80a0-b7a4-4ae8-89a1-f4c268d41201 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.184184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb80a0-b7a4-4ae8-89a1-f4c268d41201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.185910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3a8f4-77e3-420f-9dcb-bd65758320de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.186597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a8f4-77e3-420f-9dcb-bd65758320de admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.186728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb80a0-b7a4-4ae8-89a1-f4c268d41201 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.186887 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a8f4-77e3-420f-9dcb-bd65758320de admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.187175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a8f4-77e3-420f-9dcb-bd65758320de admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.187866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3a8f4-77e3-420f-9dcb-bd65758320de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.189781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3a8f4-77e3-420f-9dcb-bd65758320de admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.196229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:10.209165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 788/1580] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:10 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:10.210028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb80a0-b7a4-4ae8-89a1-f4c268d41201 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.219232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 793/1581] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:10 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:10.219527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb80a0-b7a4-4ae8-89a1-f4c268d41201 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.220332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3a8f4-77e3-420f-9dcb-bd65758320de admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.268001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:10.278664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3815c-b6f0-4b5d-b95a-6efab2879407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.280020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3815c-b6f0-4b5d-b95a-6efab2879407 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.280385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3815c-b6f0-4b5d-b95a-6efab2879407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.280727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3815c-b6f0-4b5d-b95a-6efab2879407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.281518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3815c-b6f0-4b5d-b95a-6efab2879407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.283212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3815c-b6f0-4b5d-b95a-6efab2879407 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.287299 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3a8f4-77e3-420f-9dcb-bd65758320de admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.292951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 789/1582] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.293727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3815c-b6f0-4b5d-b95a-6efab2879407 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.294505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0971d3-c0e3-4261-9b1b-0684d5e37fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.295191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0971d3-c0e3-4261-9b1b-0684d5e37fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.295475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0971d3-c0e3-4261-9b1b-0684d5e37fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.295755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0971d3-c0e3-4261-9b1b-0684d5e37fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.296794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0971d3-c0e3-4261-9b1b-0684d5e37fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.298398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0971d3-c0e3-4261-9b1b-0684d5e37fe1 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.304039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3815c-b6f0-4b5d-b95a-6efab2879407 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.308249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 794/1583] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.309177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0971d3-c0e3-4261-9b1b-0684d5e37fe1 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.311968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77af7b-e618-417f-85b9-2387349c0fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.312642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77af7b-e618-417f-85b9-2387349c0fdc admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.312929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77af7b-e618-417f-85b9-2387349c0fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.313204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77af7b-e618-417f-85b9-2387349c0fdc admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.313882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77af7b-e618-417f-85b9-2387349c0fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.315779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77af7b-e618-417f-85b9-2387349c0fdc admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.318670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0971d3-c0e3-4261-9b1b-0684d5e37fe1 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.323242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7498b-b7e0-4fac-9553-84eb3e4bed21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.323867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7498b-b7e0-4fac-9553-84eb3e4bed21 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.324206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7498b-b7e0-4fac-9553-84eb3e4bed21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.324512 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7498b-b7e0-4fac-9553-84eb3e4bed21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.325222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7498b-b7e0-4fac-9553-84eb3e4bed21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.327613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7498b-b7e0-4fac-9553-84eb3e4bed21 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.336519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 790/1584] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:10 2022] POST /identity/v3/users => generated 296 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:10.337801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cad52c-d722-4782-bfc5-6d6d13a74b74 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.338271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 795/1585] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.338984 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7498b-b7e0-4fac-9553-84eb3e4bed21 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.341116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cad52c-d722-4782-bfc5-6d6d13a74b74 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.341421 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cad52c-d722-4782-bfc5-6d6d13a74b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.350632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7498b-b7e0-4fac-9553-84eb3e4bed21 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.355557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557c6f-95ba-4ccf-86a0-becf8874dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.356195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557c6f-95ba-4ccf-86a0-becf8874dc3a admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.356579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557c6f-95ba-4ccf-86a0-becf8874dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.356857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557c6f-95ba-4ccf-86a0-becf8874dc3a admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.357563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c557c6f-95ba-4ccf-86a0-becf8874dc3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.359507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c557c6f-95ba-4ccf-86a0-becf8874dc3a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.367200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-79cad52c-d722-4782-bfc5-6d6d13a74b74 None None] MFA Rules not processed for user `9c16c704d1b74ae5b2b7d60cea60606d`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:10.368430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-79cad52c-d722-4782-bfc5-6d6d13a74b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:10.383140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 796/1586] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:10 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:10.383140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557c6f-95ba-4ccf-86a0-becf8874dc3a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.390735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557c6f-95ba-4ccf-86a0-becf8874dc3a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.395328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59011fe1-7f51-4460-9bb5-e54126238fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.395965 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59011fe1-7f51-4460-9bb5-e54126238fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.396536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59011fe1-7f51-4460-9bb5-e54126238fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.396814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59011fe1-7f51-4460-9bb5-e54126238fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.397546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59011fe1-7f51-4460-9bb5-e54126238fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.399244 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59011fe1-7f51-4460-9bb5-e54126238fbc admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.409286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 797/1587] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.410413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59011fe1-7f51-4460-9bb5-e54126238fbc admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.420408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59011fe1-7f51-4460-9bb5-e54126238fbc admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.424949 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505fa52-aae0-4875-a661-b0b7b5a9ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.425579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505fa52-aae0-4875-a661-b0b7b5a9ebe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.425863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505fa52-aae0-4875-a661-b0b7b5a9ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.426158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505fa52-aae0-4875-a661-b0b7b5a9ebe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.426836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505fa52-aae0-4875-a661-b0b7b5a9ebe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.428806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505fa52-aae0-4875-a661-b0b7b5a9ebe3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.436118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 791/1588] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:10.437007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cad52c-d722-4782-bfc5-6d6d13a74b74 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.448850 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cad52c-d722-4782-bfc5-6d6d13a74b74 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.454242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 798/1589] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:10 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:10.454400 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7037ab4-0cec-4c64-8660-e4ab42563c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.455016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037ab4-0cec-4c64-8660-e4ab42563c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.455140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505fa52-aae0-4875-a661-b0b7b5a9ebe3 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.455314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037ab4-0cec-4c64-8660-e4ab42563c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.455570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037ab4-0cec-4c64-8660-e4ab42563c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.456304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7037ab4-0cec-4c64-8660-e4ab42563c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.457947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7037ab4-0cec-4c64-8660-e4ab42563c5a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.469335 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 792/1590] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.470299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7037ab4-0cec-4c64-8660-e4ab42563c5a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.473547 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505fa52-aae0-4875-a661-b0b7b5a9ebe3 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.481018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d20b72-4394-4846-8ec2-90275a3ccf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.482044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d20b72-4394-4846-8ec2-90275a3ccf77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.482658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d20b72-4394-4846-8ec2-90275a3ccf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.482774 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7037ab4-0cec-4c64-8660-e4ab42563c5a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.483005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d20b72-4394-4846-8ec2-90275a3ccf77 admin admin] PATH_INFO: `/v3/projects/7b063503262a412b849f30128cb3a462/users/3697157da50f43a687a0e9610f801fbb/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.488652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f66d8-5197-44ce-b867-e288ca6fd2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.489333 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f66d8-5197-44ce-b867-e288ca6fd2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.489630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f66d8-5197-44ce-b867-e288ca6fd2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.489883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f66d8-5197-44ce-b867-e288ca6fd2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.490606 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f66d8-5197-44ce-b867-e288ca6fd2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.492641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f66d8-5197-44ce-b867-e288ca6fd2ba admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.498402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d20b72-4394-4846-8ec2-90275a3ccf77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b063503262a412b849f30128cb3a462, user_id=3697157da50f43a687a0e9610f801fbb, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.501106 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d20b72-4394-4846-8ec2-90275a3ccf77 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.502913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 793/1591] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.503751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f66d8-5197-44ce-b867-e288ca6fd2ba admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.516755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f66d8-5197-44ce-b867-e288ca6fd2ba admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.517718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 799/1592] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:10 2022] PUT /identity/v3/projects/7b063503262a412b849f30128cb3a462/users/3697157da50f43a687a0e9610f801fbb/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:10.525215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d20b72-4394-4846-8ec2-90275a3ccf77 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.557968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:10.575749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efab27-ad2e-489c-9bf5-96fa7c047c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.577224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efab27-ad2e-489c-9bf5-96fa7c047c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.577504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efab27-ad2e-489c-9bf5-96fa7c047c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.577778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efab27-ad2e-489c-9bf5-96fa7c047c88 admin admin] PATH_INFO: `/v3/projects/ad47dbec17954b6da5aee78946535698/users/7f9f7b8e1f534e8f86d9cde7c0b4f633/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.587735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d20b72-4394-4846-8ec2-90275a3ccf77 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.591758 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efab27-ad2e-489c-9bf5-96fa7c047c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad47dbec17954b6da5aee78946535698, user_id=7f9f7b8e1f534e8f86d9cde7c0b4f633, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.592509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb162b56-0788-4012-9fa6-ba0b17b41ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.592822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-26efab27-ad2e-489c-9bf5-96fa7c047c88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:10.592822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: warnings.warn(msg) Jun 20 06:07:10.592822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: Jun 20 06:07:10.593176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb162b56-0788-4012-9fa6-ba0b17b41ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.593464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb162b56-0788-4012-9fa6-ba0b17b41ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.593743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb162b56-0788-4012-9fa6-ba0b17b41ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.594474 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb162b56-0788-4012-9fa6-ba0b17b41ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.594749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efab27-ad2e-489c-9bf5-96fa7c047c88 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.596090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb162b56-0788-4012-9fa6-ba0b17b41ae0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.606478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 800/1593] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.607383 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb162b56-0788-4012-9fa6-ba0b17b41ae0 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.608389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 794/1594] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:10 2022] PUT /identity/v3/projects/ad47dbec17954b6da5aee78946535698/users/7f9f7b8e1f534e8f86d9cde7c0b4f633/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:10.609156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efab27-ad2e-489c-9bf5-96fa7c047c88 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.617320 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb162b56-0788-4012-9fa6-ba0b17b41ae0 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.664234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:10.672950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efab27-ad2e-489c-9bf5-96fa7c047c88 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.674755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1378d3-9482-40ba-9023-6133e9ccbf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.675431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1378d3-9482-40ba-9023-6133e9ccbf94 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.675716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1378d3-9482-40ba-9023-6133e9ccbf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.675994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1378d3-9482-40ba-9023-6133e9ccbf94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.676764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1378d3-9482-40ba-9023-6133e9ccbf94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.677796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5c930-f4f9-4020-a452-dd46cff2b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.678365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1378d3-9482-40ba-9023-6133e9ccbf94 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.678573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c930-f4f9-4020-a452-dd46cff2b0db admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.678951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c930-f4f9-4020-a452-dd46cff2b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.679180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5c930-f4f9-4020-a452-dd46cff2b0db admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.679914 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5c930-f4f9-4020-a452-dd46cff2b0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.681541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5c930-f4f9-4020-a452-dd46cff2b0db admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.688723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 801/1595] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.690003 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf7426-773d-4771-9cc5-4938f07b1a58 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.690296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf7426-773d-4771-9cc5-4938f07b1a58 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.690574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf7426-773d-4771-9cc5-4938f07b1a58 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.691847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 802/1596] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jun 20 06:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:10.692547 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf7426-773d-4771-9cc5-4938f07b1a58 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.696391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 795/1597] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.696391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5c930-f4f9-4020-a452-dd46cff2b0db admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.704484 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5c930-f4f9-4020-a452-dd46cff2b0db admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.707694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf7426-773d-4771-9cc5-4938f07b1a58 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.709100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc91e5-f0bd-4a61-a06a-a02e70f696ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.709740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc91e5-f0bd-4a61-a06a-a02e70f696ca admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.710026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc91e5-f0bd-4a61-a06a-a02e70f696ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.710302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc91e5-f0bd-4a61-a06a-a02e70f696ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.711015 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc91e5-f0bd-4a61-a06a-a02e70f696ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.712446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd7960-6776-41a3-b418-ae8cba42ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.712633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc91e5-f0bd-4a61-a06a-a02e70f696ca admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.713305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7960-6776-41a3-b418-ae8cba42ac7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.713587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7960-6776-41a3-b418-ae8cba42ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.713863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd7960-6776-41a3-b418-ae8cba42ac7e admin admin] PATH_INFO: `/v3/projects/2753e6f236134634837eddbfe2754764/users/6bad8a4de2c84319a8601e7625c2655e/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.722564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 796/1598] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.723639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cf8ef-b1de-43c4-9d35-d04e9b9f7c61 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.723931 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cf8ef-b1de-43c4-9d35-d04e9b9f7c61 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.724207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cf8ef-b1de-43c4-9d35-d04e9b9f7c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.732340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd7960-6776-41a3-b418-ae8cba42ac7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2753e6f236134634837eddbfe2754764, user_id=6bad8a4de2c84319a8601e7625c2655e, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.735019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd7960-6776-41a3-b418-ae8cba42ac7e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.748701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 803/1599] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:10 2022] PUT /identity/v3/projects/2753e6f236134634837eddbfe2754764/users/6bad8a4de2c84319a8601e7625c2655e/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:10.750071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c591-83c3-4bde-a62f-2b0c04f306da None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.750466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c591-83c3-4bde-a62f-2b0c04f306da None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.750575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c49cf8ef-b1de-43c4-9d35-d04e9b9f7c61 None None] MFA Rules not processed for user `3697157da50f43a687a0e9610f801fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:10.750937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693c591-83c3-4bde-a62f-2b0c04f306da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.751761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c49cf8ef-b1de-43c4-9d35-d04e9b9f7c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:10.767538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c693c591-83c3-4bde-a62f-2b0c04f306da None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:10.768788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c693c591-83c3-4bde-a62f-2b0c04f306da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:10.816734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 797/1600] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:10.817885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cf8ef-b1de-43c4-9d35-d04e9b9f7c61 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.832190 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 804/1601] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:10.833042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693c591-83c3-4bde-a62f-2b0c04f306da None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.842930 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693c591-83c3-4bde-a62f-2b0c04f306da None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.847590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb04a8-b6ab-4fa7-b992-e5cf4a6ef263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.849055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb04a8-b6ab-4fa7-b992-e5cf4a6ef263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.849339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb04a8-b6ab-4fa7-b992-e5cf4a6ef263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.849699 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb04a8-b6ab-4fa7-b992-e5cf4a6ef263 admin admin] PATH_INFO: `/v3/projects/75da8e80167b45b0b1f370a7c0030add/users/849884e15b32483e927a0b51a9f7aa49/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.865517 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb04a8-b6ab-4fa7-b992-e5cf4a6ef263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75da8e80167b45b0b1f370a7c0030add, user_id=849884e15b32483e927a0b51a9f7aa49, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.865975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:10.868516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb04a8-b6ab-4fa7-b992-e5cf4a6ef263 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.881237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 805/1602] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:10 2022] PUT /identity/v3/projects/75da8e80167b45b0b1f370a7c0030add/users/849884e15b32483e927a0b51a9f7aa49/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:10.882101 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb04a8-b6ab-4fa7-b992-e5cf4a6ef263 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.888488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cf8ef-b1de-43c4-9d35-d04e9b9f7c61 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.944822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581000b-72e0-4437-a06e-0d4266deedfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.945475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581000b-72e0-4437-a06e-0d4266deedfe admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.945705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581000b-72e0-4437-a06e-0d4266deedfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.945978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581000b-72e0-4437-a06e-0d4266deedfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.946697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581000b-72e0-4437-a06e-0d4266deedfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.948347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581000b-72e0-4437-a06e-0d4266deedfe admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.948470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb04a8-b6ab-4fa7-b992-e5cf4a6ef263 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.953786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ec54-e99e-4211-ad11-c29af69dab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.954849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ec54-e99e-4211-ad11-c29af69dab0d admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.954849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ec54-e99e-4211-ad11-c29af69dab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.955012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375ec54-e99e-4211-ad11-c29af69dab0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.955829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375ec54-e99e-4211-ad11-c29af69dab0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:10.957596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375ec54-e99e-4211-ad11-c29af69dab0d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:10.960829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 798/1603] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.962243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67e4c5-13b7-4130-850e-3124924fe5ae None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.962532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67e4c5-13b7-4130-850e-3124924fe5ae None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.962808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67e4c5-13b7-4130-850e-3124924fe5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:10.972636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 806/1604] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:10.973517 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ec54-e99e-4211-ad11-c29af69dab0d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:10.982754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-de67e4c5-13b7-4130-850e-3124924fe5ae None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:10.983120 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375ec54-e99e-4211-ad11-c29af69dab0d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:10.984025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-de67e4c5-13b7-4130-850e-3124924fe5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:10.988032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63853275-74b5-430b-96db-4358384831cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:10.988939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63853275-74b5-430b-96db-4358384831cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:10.989259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63853275-74b5-430b-96db-4358384831cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:10.989564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63853275-74b5-430b-96db-4358384831cb admin admin] PATH_INFO: `/v3/projects/2e86727ed46d4b9d9297f9586930023a/users/57b64cdf97214cddb23851747cb051d4/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.004213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63853275-74b5-430b-96db-4358384831cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e86727ed46d4b9d9297f9586930023a, user_id=57b64cdf97214cddb23851747cb051d4, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:11.006916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63853275-74b5-430b-96db-4358384831cb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:11.021521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 807/1605] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:10 2022] PUT /identity/v3/projects/2e86727ed46d4b9d9297f9586930023a/users/57b64cdf97214cddb23851747cb051d4/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:11.023105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16795f-b3a7-4435-a4fc-355247bacac8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.023483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16795f-b3a7-4435-a4fc-355247bacac8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.023765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16795f-b3a7-4435-a4fc-355247bacac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.040286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-9a16795f-b3a7-4435-a4fc-355247bacac8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:11.041625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9a16795f-b3a7-4435-a4fc-355247bacac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:11.050402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:11.052542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 799/1606] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jun 20 06:07:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:11.053990 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67e4c5-13b7-4130-850e-3124924fe5ae None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:11.109847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 808/1607] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:11.110702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16795f-b3a7-4435-a4fc-355247bacac8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:11.110806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67e4c5-13b7-4130-850e-3124924fe5ae None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:11.140563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:11.161904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208011f6-7869-47f2-b8f9-508cb9a21c86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:11.162555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208011f6-7869-47f2-b8f9-508cb9a21c86 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.162834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208011f6-7869-47f2-b8f9-508cb9a21c86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.163109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208011f6-7869-47f2-b8f9-508cb9a21c86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.165995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16795f-b3a7-4435-a4fc-355247bacac8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:11.170172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e7aa0-3c7d-40a2-b441-804fd9376d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:11.170816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e7aa0-3c7d-40a2-b441-804fd9376d64 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.171101 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e7aa0-3c7d-40a2-b441-804fd9376d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.171380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e7aa0-3c7d-40a2-b441-804fd9376d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.180303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e7aa0-3c7d-40a2-b441-804fd9376d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:11.181758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e7aa0-3c7d-40a2-b441-804fd9376d64 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:11.191780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 809/1608] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:11.194118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e9a8-8c09-4bdc-a9a5-a8593ca17f53 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.194683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e9a8-8c09-4bdc-a9a5-a8593ca17f53 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.195171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674e9a8-8c09-4bdc-a9a5-a8593ca17f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.222481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208011f6-7869-47f2-b8f9-508cb9a21c86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:11.224530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208011f6-7869-47f2-b8f9-508cb9a21c86 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:11.226374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-6674e9a8-8c09-4bdc-a9a5-a8593ca17f53 None None] MFA Rules not processed for user `849884e15b32483e927a0b51a9f7aa49`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:11.227573 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6674e9a8-8c09-4bdc-a9a5-a8593ca17f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:11.240700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 800/1609] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:11.245343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208011f6-7869-47f2-b8f9-508cb9a21c86 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:11.257095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208011f6-7869-47f2-b8f9-508cb9a21c86 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:11.262973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96073496-f107-491d-86f8-8dbae6d4d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:11.264383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073496-f107-491d-86f8-8dbae6d4d487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.264783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073496-f107-491d-86f8-8dbae6d4d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.265455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073496-f107-491d-86f8-8dbae6d4d487 admin admin] PATH_INFO: `/v3/projects/916417cb906e4f35a3b7fd9f5f52bd16/users/c2b89a9466d848529893af51e99be1a8/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.286784 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96073496-f107-491d-86f8-8dbae6d4d487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916417cb906e4f35a3b7fd9f5f52bd16, user_id=c2b89a9466d848529893af51e99be1a8, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:11.291218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96073496-f107-491d-86f8-8dbae6d4d487 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:11.306510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 801/1610] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:11 2022] PUT /identity/v3/projects/916417cb906e4f35a3b7fd9f5f52bd16/users/c2b89a9466d848529893af51e99be1a8/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:11.307660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96073496-f107-491d-86f8-8dbae6d4d487 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:11.320618 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 810/1611] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:11.325421 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fea76-f1e6-45a5-8589-1da486df3191 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.325834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fea76-f1e6-45a5-8589-1da486df3191 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.326250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fea76-f1e6-45a5-8589-1da486df3191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.347420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b02fea76-f1e6-45a5-8589-1da486df3191 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:11.348402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b02fea76-f1e6-45a5-8589-1da486df3191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:11.385519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96073496-f107-491d-86f8-8dbae6d4d487 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:11.398734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfde0c-c318-4bb4-903a-2ec1d4a0d7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:11.399960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfde0c-c318-4bb4-903a-2ec1d4a0d7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.400396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfde0c-c318-4bb4-903a-2ec1d4a0d7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.400928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfde0c-c318-4bb4-903a-2ec1d4a0d7ca admin admin] PATH_INFO: `/v3/projects/a455398f7d314c3d8accd373e4fa24de/users/70235495a2a24424b91b21d644f04f00/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.405903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:11.420803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfde0c-c318-4bb4-903a-2ec1d4a0d7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a455398f7d314c3d8accd373e4fa24de, user_id=70235495a2a24424b91b21d644f04f00, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:11.423939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfde0c-c318-4bb4-903a-2ec1d4a0d7ca admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:11.437249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 811/1612] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:11.438093 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fea76-f1e6-45a5-8589-1da486df3191 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:11.439681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 802/1613] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:11 2022] PUT /identity/v3/projects/a455398f7d314c3d8accd373e4fa24de/users/70235495a2a24424b91b21d644f04f00/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:11.449411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfde0c-c318-4bb4-903a-2ec1d4a0d7ca admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:11.502647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:11.524099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfde0c-c318-4bb4-903a-2ec1d4a0d7ca admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:11.528851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714680f-69b7-4277-8254-c13b3ef077c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:11.530968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714680f-69b7-4277-8254-c13b3ef077c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.531454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714680f-69b7-4277-8254-c13b3ef077c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.532086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714680f-69b7-4277-8254-c13b3ef077c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.564384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fea76-f1e6-45a5-8589-1da486df3191 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:11.620685 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714680f-69b7-4277-8254-c13b3ef077c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:11.622452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714680f-69b7-4277-8254-c13b3ef077c2 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:11.634390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 803/1614] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:11.635875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc0d58-ab9f-4f76-be08-d79cc9eae6e1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.636294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc0d58-ab9f-4f76-be08-d79cc9eae6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.636686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc0d58-ab9f-4f76-be08-d79cc9eae6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.655224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d75f6-1b93-440f-81c2-b9643460d196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:11.656017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d75f6-1b93-440f-81c2-b9643460d196 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.656434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d75f6-1b93-440f-81c2-b9643460d196 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.656816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d75f6-1b93-440f-81c2-b9643460d196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.660419 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0ecc0d58-ab9f-4f76-be08-d79cc9eae6e1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:11.662129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0ecc0d58-ab9f-4f76-be08-d79cc9eae6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:11.685905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 804/1615] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:11.686865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc0d58-ab9f-4f76-be08-d79cc9eae6e1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:11.708135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc0d58-ab9f-4f76-be08-d79cc9eae6e1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:11.714753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6527e-8137-4792-a860-7f0adf066ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:11.715846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6527e-8137-4792-a860-7f0adf066ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.716138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6527e-8137-4792-a860-7f0adf066ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.717478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6527e-8137-4792-a860-7f0adf066ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.718204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6527e-8137-4792-a860-7f0adf066ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:11.721516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6527e-8137-4792-a860-7f0adf066ed2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:11.734640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d75f6-1b93-440f-81c2-b9643460d196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:11.737062 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d75f6-1b93-440f-81c2-b9643460d196 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:11.749788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 812/1616] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:11.750785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d75f6-1b93-440f-81c2-b9643460d196 service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:11.752256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-248d75f6-1b93-440f-81c2-b9643460d196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:11.771804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d75f6-1b93-440f-81c2-b9643460d196 service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:11.772972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 805/1617] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:11 2022] POST /identity/v3/projects => generated 401 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:11.778764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32ab7b-f6fa-4f4c-a895-6e47c297e4d1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.779496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32ab7b-f6fa-4f4c-a895-6e47c297e4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.780307 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32ab7b-f6fa-4f4c-a895-6e47c297e4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.813203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:11.826156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ac32ab7b-f6fa-4f4c-a895-6e47c297e4d1 None None] MFA Rules not processed for user `70235495a2a24424b91b21d644f04f00`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:11.827407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ac32ab7b-f6fa-4f4c-a895-6e47c297e4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:11.853150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888084d-dadf-48ae-8454-22eb85fef61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:11.853905 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888084d-dadf-48ae-8454-22eb85fef61f service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.854264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888084d-dadf-48ae-8454-22eb85fef61f service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.854629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888084d-dadf-48ae-8454-22eb85fef61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.931832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 806/1618] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:11.932775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32ab7b-f6fa-4f4c-a895-6e47c297e4d1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:11.948271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32ab7b-f6fa-4f4c-a895-6e47c297e4d1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:11.954164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116f3fa-8e77-4b8e-a3fe-c75244133b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:11.955742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116f3fa-8e77-4b8e-a3fe-c75244133b99 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:11.956045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116f3fa-8e77-4b8e-a3fe-c75244133b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:11.956446 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116f3fa-8e77-4b8e-a3fe-c75244133b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:11.976470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888084d-dadf-48ae-8454-22eb85fef61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:11.980497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888084d-dadf-48ae-8454-22eb85fef61f service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:11.997016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 813/1619] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:11.998202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888084d-dadf-48ae-8454-22eb85fef61f service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:12.009299 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888084d-dadf-48ae-8454-22eb85fef61f service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:12.018563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4441f5-9d24-43d5-9746-3a792d4ad318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:12.029621 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4441f5-9d24-43d5-9746-3a792d4ad318 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.040165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4441f5-9d24-43d5-9746-3a792d4ad318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.040165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4441f5-9d24-43d5-9746-3a792d4ad318 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.040165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4441f5-9d24-43d5-9746-3a792d4ad318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:12.040165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4441f5-9d24-43d5-9746-3a792d4ad318 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:12.069349 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 814/1620] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:11 2022] POST /identity/v3/users => generated 307 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:12.070321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4441f5-9d24-43d5-9746-3a792d4ad318 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:12.071012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:12.082458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4441f5-9d24-43d5-9746-3a792d4ad318 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:12.088111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d8aac-2165-4c94-9521-ccfa0b44cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:12.088967 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d8aac-2165-4c94-9521-ccfa0b44cfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.089538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d8aac-2165-4c94-9521-ccfa0b44cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.089655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d8aac-2165-4c94-9521-ccfa0b44cfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.090433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d8aac-2165-4c94-9521-ccfa0b44cfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:12.093691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d8aac-2165-4c94-9521-ccfa0b44cfe0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:12.108728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116f3fa-8e77-4b8e-a3fe-c75244133b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:12.111910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116f3fa-8e77-4b8e-a3fe-c75244133b99 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:12.143044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 815/1621] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:12 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:12.147188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d8aac-2165-4c94-9521-ccfa0b44cfe0 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:12.150612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 807/1622] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:12.151448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116f3fa-8e77-4b8e-a3fe-c75244133b99 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:12.175798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116f3fa-8e77-4b8e-a3fe-c75244133b99 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:12.356534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d8aac-2165-4c94-9521-ccfa0b44cfe0 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:12.357588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea7810-ccb6-42e7-a33d-5932cf011404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:12.358684 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7810-ccb6-42e7-a33d-5932cf011404 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.359481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7810-ccb6-42e7-a33d-5932cf011404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.360365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea7810-ccb6-42e7-a33d-5932cf011404 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.361471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea7810-ccb6-42e7-a33d-5932cf011404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:12.364344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea7810-ccb6-42e7-a33d-5932cf011404 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:12.375395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26ff7e-1e9c-4966-8abd-7a1d71ec359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:12.376472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26ff7e-1e9c-4966-8abd-7a1d71ec359c admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.378095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26ff7e-1e9c-4966-8abd-7a1d71ec359c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.379015 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26ff7e-1e9c-4966-8abd-7a1d71ec359c admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.380140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26ff7e-1e9c-4966-8abd-7a1d71ec359c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:12.382268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26ff7e-1e9c-4966-8abd-7a1d71ec359c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:12.404750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 816/1623] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:12.405808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0dab0-95ec-4bed-a2bf-a96441cd630a None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.406491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0dab0-95ec-4bed-a2bf-a96441cd630a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.407009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0dab0-95ec-4bed-a2bf-a96441cd630a None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.409140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 817/1624] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jun 20 06:07:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:12.409827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0dab0-95ec-4bed-a2bf-a96441cd630a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:12.423829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 808/1625] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:12 2022] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:12.429053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e684-03d5-4a03-bd88-49ba5dcffc20 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.429298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e684-03d5-4a03-bd88-49ba5dcffc20 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.429846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407e684-03d5-4a03-bd88-49ba5dcffc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.440921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0dab0-95ec-4bed-a2bf-a96441cd630a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:12.449228 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28365cec-4839-4630-8270-0d02e117a5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:12.450722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28365cec-4839-4630-8270-0d02e117a5cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.452497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28365cec-4839-4630-8270-0d02e117a5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.453826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28365cec-4839-4630-8270-0d02e117a5cb admin admin] PATH_INFO: `/v3/projects/3a69427b7d2142fa9531282f59892f70/users/f1af2c71c12e4c40973c48994bb8ac2c/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.459119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0407e684-03d5-4a03-bd88-49ba5dcffc20 None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:12.460712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0407e684-03d5-4a03-bd88-49ba5dcffc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:12.475410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28365cec-4839-4630-8270-0d02e117a5cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a69427b7d2142fa9531282f59892f70, user_id=f1af2c71c12e4c40973c48994bb8ac2c, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:12.478762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28365cec-4839-4630-8270-0d02e117a5cb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:12.504784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 818/1626] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:12 2022] PUT /identity/v3/projects/3a69427b7d2142fa9531282f59892f70/users/f1af2c71c12e4c40973c48994bb8ac2c/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:12.506618 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28365cec-4839-4630-8270-0d02e117a5cb admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:12.513012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:12.580047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 809/1627] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:07:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:12.582057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407e684-03d5-4a03-bd88-49ba5dcffc20 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:12.603671 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407e684-03d5-4a03-bd88-49ba5dcffc20 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:12.603952 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28365cec-4839-4630-8270-0d02e117a5cb admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:12.610937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5196ba-72f8-44a8-b72e-b6013e850403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:12.611388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88ecdf-48cd-451d-a800-42edea80ede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:12.611659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5196ba-72f8-44a8-b72e-b6013e850403 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.611951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5196ba-72f8-44a8-b72e-b6013e850403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.612234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5196ba-72f8-44a8-b72e-b6013e850403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.613012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5196ba-72f8-44a8-b72e-b6013e850403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:12.614375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88ecdf-48cd-451d-a800-42edea80ede5 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.614867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5196ba-72f8-44a8-b72e-b6013e850403 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:12.615907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88ecdf-48cd-451d-a800-42edea80ede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.617622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88ecdf-48cd-451d-a800-42edea80ede5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.619553 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88ecdf-48cd-451d-a800-42edea80ede5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:12.625224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88ecdf-48cd-451d-a800-42edea80ede5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:12.637495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 810/1628] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:12.639246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5196ba-72f8-44a8-b72e-b6013e850403 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:12.642805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 819/1629] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:12.643766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88ecdf-48cd-451d-a800-42edea80ede5 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:12.664011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88ecdf-48cd-451d-a800-42edea80ede5 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:12.683711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe740b-ebc2-457f-a50f-916e7e09abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:12.684709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe740b-ebc2-457f-a50f-916e7e09abe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.685013 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe740b-ebc2-457f-a50f-916e7e09abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.685854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe740b-ebc2-457f-a50f-916e7e09abe7 admin admin] PATH_INFO: `/v3/projects/3a69427b7d2142fa9531282f59892f70/users/f1af2c71c12e4c40973c48994bb8ac2c/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.688091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe740b-ebc2-457f-a50f-916e7e09abe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a69427b7d2142fa9531282f59892f70, user_id=f1af2c71c12e4c40973c48994bb8ac2c, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:12.692752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe740b-ebc2-457f-a50f-916e7e09abe7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:12.713823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 820/1630] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:12 2022] PUT /identity/v3/projects/3a69427b7d2142fa9531282f59892f70/users/f1af2c71c12e4c40973c48994bb8ac2c/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:12.725306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe740b-ebc2-457f-a50f-916e7e09abe7 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:12.781493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5196ba-72f8-44a8-b72e-b6013e850403 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:12.809982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:12.888357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe740b-ebc2-457f-a50f-916e7e09abe7 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:12.900084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85fa23-a253-43ed-9f81-709d828e3b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:12.901475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85fa23-a253-43ed-9f81-709d828e3b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.902326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85fa23-a253-43ed-9f81-709d828e3b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.902611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85fa23-a253-43ed-9f81-709d828e3b14 admin admin] PATH_INFO: `/v3/projects/53ba89a5fe684cff815af90ac2e20b93/users/e9f6a506edc048c8896ada008b69d1a3/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.907918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede47ce9-8406-4bf6-847e-4d662f9388c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:12.908621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede47ce9-8406-4bf6-847e-4d662f9388c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.908907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede47ce9-8406-4bf6-847e-4d662f9388c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.909186 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede47ce9-8406-4bf6-847e-4d662f9388c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:12.946669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85fa23-a253-43ed-9f81-709d828e3b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ba89a5fe684cff815af90ac2e20b93, user_id=e9f6a506edc048c8896ada008b69d1a3, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:12.949465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85fa23-a253-43ed-9f81-709d828e3b14 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:12.980074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 821/1631] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:12 2022] PUT /identity/v3/projects/53ba89a5fe684cff815af90ac2e20b93/users/e9f6a506edc048c8896ada008b69d1a3/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:12.984650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc965734-f75e-4618-a1f7-7a782a759387 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:12.984950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc965734-f75e-4618-a1f7-7a782a759387 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:12.985319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc965734-f75e-4618-a1f7-7a782a759387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:13.042141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-cc965734-f75e-4618-a1f7-7a782a759387 None None] MFA Rules not processed for user `f1af2c71c12e4c40973c48994bb8ac2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:13.043383 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-cc965734-f75e-4618-a1f7-7a782a759387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:13.069511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede47ce9-8406-4bf6-847e-4d662f9388c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:13.074596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede47ce9-8406-4bf6-847e-4d662f9388c6 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:13.097598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 811/1632] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:13.098769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede47ce9-8406-4bf6-847e-4d662f9388c6 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:13.115918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede47ce9-8406-4bf6-847e-4d662f9388c6 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:13.206135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:13.231743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 822/1633] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:13.245094 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc965734-f75e-4618-a1f7-7a782a759387 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:13.309442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89629-059e-4ad5-bcdd-cf7841ca29f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:13.310932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89629-059e-4ad5-bcdd-cf7841ca29f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:13.311219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89629-059e-4ad5-bcdd-cf7841ca29f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:13.311725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89629-059e-4ad5-bcdd-cf7841ca29f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:13.312453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a89629-059e-4ad5-bcdd-cf7841ca29f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:13.317443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a89629-059e-4ad5-bcdd-cf7841ca29f9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:13.346417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 812/1634] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:13.350255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89629-059e-4ad5-bcdd-cf7841ca29f9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:13.361650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89629-059e-4ad5-bcdd-cf7841ca29f9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:13.365484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc965734-f75e-4618-a1f7-7a782a759387 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:13.369063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed40fc-5565-4aa7-869b-4416763c3f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:13.370307 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed40fc-5565-4aa7-869b-4416763c3f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:13.370858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed40fc-5565-4aa7-869b-4416763c3f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:13.371357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed40fc-5565-4aa7-869b-4416763c3f6b admin admin] PATH_INFO: `/v3/projects/53ba89a5fe684cff815af90ac2e20b93/users/e9f6a506edc048c8896ada008b69d1a3/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:13.373960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed40fc-5565-4aa7-869b-4416763c3f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ba89a5fe684cff815af90ac2e20b93, user_id=e9f6a506edc048c8896ada008b69d1a3, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:13.376151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9a5c8-0aa7-4d1b-ab3a-fce1119f5066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:13.376842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9a5c8-0aa7-4d1b-ab3a-fce1119f5066 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:13.377135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9a5c8-0aa7-4d1b-ab3a-fce1119f5066 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:13.377418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9a5c8-0aa7-4d1b-ab3a-fce1119f5066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:13.378942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed40fc-5565-4aa7-869b-4416763c3f6b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:13.395912 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 813/1635] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:13 2022] PUT /identity/v3/projects/53ba89a5fe684cff815af90ac2e20b93/users/e9f6a506edc048c8896ada008b69d1a3/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:13.403194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9a5c8-0aa7-4d1b-ab3a-fce1119f5066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:13.405391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9a5c8-0aa7-4d1b-ab3a-fce1119f5066 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:13.408377 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1ddf7-b6c0-4c9f-8413-889bcafcbec9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:13.409106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1ddf7-b6c0-4c9f-8413-889bcafcbec9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:13.409935 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1ddf7-b6c0-4c9f-8413-889bcafcbec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:13.424494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 823/1636] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:07:13.465906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-05d1ddf7-b6c0-4c9f-8413-889bcafcbec9 None None] MFA Rules not processed for user `e9f6a506edc048c8896ada008b69d1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:13.467524 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-05d1ddf7-b6c0-4c9f-8413-889bcafcbec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:13.516364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:13.572392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 814/1637] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:13.635623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9a5c8-0aa7-4d1b-ab3a-fce1119f5066 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:13.647973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9a5c8-0aa7-4d1b-ab3a-fce1119f5066 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:13.800112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd72cd7-0420-4ec3-87e2-8da6651aeb67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:13.802588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd72cd7-0420-4ec3-87e2-8da6651aeb67 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:13.803245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd72cd7-0420-4ec3-87e2-8da6651aeb67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:13.803879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd72cd7-0420-4ec3-87e2-8da6651aeb67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:13.843914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd72cd7-0420-4ec3-87e2-8da6651aeb67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:13.847245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd72cd7-0420-4ec3-87e2-8da6651aeb67 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:13.869079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 824/1638] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:14.054235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1ddf7-b6c0-4c9f-8413-889bcafcbec9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:14.075033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd72cd7-0420-4ec3-87e2-8da6651aeb67 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:14.093956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd72cd7-0420-4ec3-87e2-8da6651aeb67 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:14.113818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28828b0d-7668-455e-b079-7b435d384849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:14.114597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28828b0d-7668-455e-b079-7b435d384849 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:14.116658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28828b0d-7668-455e-b079-7b435d384849 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:14.117013 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28828b0d-7668-455e-b079-7b435d384849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:14.218561 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1ddf7-b6c0-4c9f-8413-889bcafcbec9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:14.229660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:14.234649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:14.234649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:14.234649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] PATH_INFO: `/v3/users/849884e15b32483e927a0b51a9f7aa49` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:14.236196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] RBAC: Authorizing `identity:delete_user(user_id=849884e15b32483e927a0b51a9f7aa49)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:14.239464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: WARNING py.warnings [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:14.239464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: warnings.warn(msg) Jun 20 06:07:14.239464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: Jun 20 06:07:14.240866 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:14.256582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28828b0d-7668-455e-b079-7b435d384849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:14.259490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28828b0d-7668-455e-b079-7b435d384849 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:14.277495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 825/1639] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:07:14.278904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538e86e-ac08-4a71-902e-0de0c4fb85cb None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:14.279201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538e86e-ac08-4a71-902e-0de0c4fb85cb None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:14.279482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538e86e-ac08-4a71-902e-0de0c4fb85cb None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:14.280964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 826/1640] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jun 20 06:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:14.286564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66681b-0af1-4672-8481-46ec0761923e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:14.287003 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66681b-0af1-4672-8481-46ec0761923e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:14.287287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66681b-0af1-4672-8481-46ec0761923e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:14.308557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-dd66681b-0af1-4672-8481-46ec0761923e None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:14.309940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-dd66681b-0af1-4672-8481-46ec0761923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:14.371668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:14.400616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849884e15b32483e927a0b51a9f7aa49'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:14.402050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849884e15b32483e927a0b51a9f7aa49'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:14.421048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 827/1641] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jun 20 06:07:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:14.423100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ccc98-9906-415c-8a2d-39c9e8d10bad None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:14.423399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ccc98-9906-415c-8a2d-39c9e8d10bad None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:14.423743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ccc98-9906-415c-8a2d-39c9e8d10bad None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:14.429216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849884e15b32483e927a0b51a9f7aa49'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:14.430264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 828/1642] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jun 20 06:07:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:14.431765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb56af4-ec4d-436a-8410-da7d48db44ea None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:14.432111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb56af4-ec4d-436a-8410-da7d48db44ea None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:14.432470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb56af4-ec4d-436a-8410-da7d48db44ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:14.446163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849884e15b32483e927a0b51a9f7aa49'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:14.446804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-dbc81213-45bc-4443-a0bf-ce4528ec751a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849884e15b32483e927a0b51a9f7aa49'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:14.489205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-5eb56af4-ec4d-436a-8410-da7d48db44ea None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:14.495496 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5eb56af4-ec4d-436a-8410-da7d48db44ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:14.500911 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 815/1643] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:14 2022] DELETE /identity/v3/users/849884e15b32483e927a0b51a9f7aa49 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:14.505161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a96e1e-45e8-4648-9821-1b8b217b0ed8 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:14.505457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a96e1e-45e8-4648-9821-1b8b217b0ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:14.505742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a96e1e-45e8-4648-9821-1b8b217b0ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:14.508089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 829/1644] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:07:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:14.523187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb56af4-ec4d-436a-8410-da7d48db44ea None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:14.526652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5eb56af4-ec4d-436a-8410-da7d48db44ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:14.547704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb56af4-ec4d-436a-8410-da7d48db44ea None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:14.558329 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a4a96e1e-45e8-4648-9821-1b8b217b0ed8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:14.559591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a4a96e1e-45e8-4648-9821-1b8b217b0ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:14.647786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5bc6d-9b4b-444c-a3bb-5aab82824109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:14.649070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bc6d-9b4b-444c-a3bb-5aab82824109 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:14.649513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bc6d-9b4b-444c-a3bb-5aab82824109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:14.649986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bc6d-9b4b-444c-a3bb-5aab82824109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:14.687529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:14.738296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 816/1645] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:14.751562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a96e1e-45e8-4648-9821-1b8b217b0ed8 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:14.760215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a4a96e1e-45e8-4648-9821-1b8b217b0ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:14.776758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5bc6d-9b4b-444c-a3bb-5aab82824109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:14.778642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5bc6d-9b4b-444c-a3bb-5aab82824109 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:14.802716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 830/1646] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:14.887638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a96e1e-45e8-4648-9821-1b8b217b0ed8 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:14.901098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8561b79-c4c4-429d-ba39-e28b60c931b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:14.902335 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8561b79-c4c4-429d-ba39-e28b60c931b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:14.902936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8561b79-c4c4-429d-ba39-e28b60c931b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:14.903766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8561b79-c4c4-429d-ba39-e28b60c931b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:14.922351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8561b79-c4c4-429d-ba39-e28b60c931b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:14.924800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8561b79-c4c4-429d-ba39-e28b60c931b8 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:14.943832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 817/1647] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:16.327651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5bc6d-9b4b-444c-a3bb-5aab82824109 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:16.329928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-51c5bc6d-9b4b-444c-a3bb-5aab82824109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:16.359312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5bc6d-9b4b-444c-a3bb-5aab82824109 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:16.377795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:16.378925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:16.379318 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:16.379704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] PATH_INFO: `/v3/projects/75da8e80167b45b0b1f370a7c0030add` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:16.383514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75da8e80167b45b0b1f370a7c0030add)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:16.385047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: WARNING py.warnings [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:07:16.385047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: warnings.warn(msg) Jun 20 06:07:16.385047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: Jun 20 06:07:16.386752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:16.494833 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8561b79-c4c4-429d-ba39-e28b60c931b8 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:16.496417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c8561b79-c4c4-429d-ba39-e28b60c931b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:16.525536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8561b79-c4c4-429d-ba39-e28b60c931b8 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:16.569029 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75da8e80167b45b0b1f370a7c0030add', 'request_id': 'req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.586442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75da8e80167b45b0b1f370a7c0030add', 'request_id': 'req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.606655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:16.615460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75da8e80167b45b0b1f370a7c0030add', 'request_id': 'req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.643728 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] The token cache is being invalidate because project 75da8e80167b45b0b1f370a7c0030add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:16.644027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.645703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.652284 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 831/1648] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:16 2022] DELETE /identity/v3/projects/75da8e80167b45b0b1f370a7c0030add => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:16.653209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:16.657232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:16.691468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bac3a-12fc-481a-b31c-ef3091b012b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:16.692946 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bac3a-12fc-481a-b31c-ef3091b012b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:16.695546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bac3a-12fc-481a-b31c-ef3091b012b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:16.695695 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bac3a-12fc-481a-b31c-ef3091b012b2 admin admin] PATH_INFO: `/v3/users/9c16c704d1b74ae5b2b7d60cea60606d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:16.706108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bac3a-12fc-481a-b31c-ef3091b012b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c16c704d1b74ae5b2b7d60cea60606d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:16.706108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bac3a-12fc-481a-b31c-ef3091b012b2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:16.823009 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-035bac3a-12fc-481a-b31c-ef3091b012b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c16c704d1b74ae5b2b7d60cea60606d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.824550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-035bac3a-12fc-481a-b31c-ef3091b012b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c16c704d1b74ae5b2b7d60cea60606d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.834177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c2607-01ba-4aa6-9a2b-fd966f5ac924 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:16.845520 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:16.846686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:16.846686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:16.846970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] PATH_INFO: `/v3/users/f1af2c71c12e4c40973c48994bb8ac2c` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:16.850472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1af2c71c12e4c40973c48994bb8ac2c)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:16.853339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:16.861672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-035bac3a-12fc-481a-b31c-ef3091b012b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c16c704d1b74ae5b2b7d60cea60606d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.890746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-035bac3a-12fc-481a-b31c-ef3091b012b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c16c704d1b74ae5b2b7d60cea60606d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.890746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-035bac3a-12fc-481a-b31c-ef3091b012b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c16c704d1b74ae5b2b7d60cea60606d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.956875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 818/1649] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:16 2022] DELETE /identity/v3/users/9c16c704d1b74ae5b2b7d60cea60606d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:07:16.958578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eef88-33d9-4b69-981f-e76543960804 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:16.958874 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eef88-33d9-4b69-981f-e76543960804 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:16.959154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eef88-33d9-4b69-981f-e76543960804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:16.967762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1af2c71c12e4c40973c48994bb8ac2c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.989681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:16.992417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1af2c71c12e4c40973c48994bb8ac2c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.993754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1af2c71c12e4c40973c48994bb8ac2c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:16.995206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1af2c71c12e4c40973c48994bb8ac2c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:17.004087 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7a4eef88-33d9-4b69-981f-e76543960804 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:17.006580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7a4eef88-33d9-4b69-981f-e76543960804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:17.032537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1af2c71c12e4c40973c48994bb8ac2c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:17.078156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 832/1650] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:16 2022] DELETE /identity/v3/users/f1af2c71c12e4c40973c48994bb8ac2c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:17.186235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 819/1651] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:17.449533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:17.449533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:17.655878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f358bc-fdcb-4f0e-838f-0b9ed863ced1 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:17.680742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574231fa-8584-48b8-8990-45c4f9c147e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:17.683407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574231fa-8584-48b8-8990-45c4f9c147e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:17.683407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574231fa-8584-48b8-8990-45c4f9c147e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:17.683407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574231fa-8584-48b8-8990-45c4f9c147e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:17.793016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:17.806580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eef88-33d9-4b69-981f-e76543960804 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:17.808259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7a4eef88-33d9-4b69-981f-e76543960804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:17.839834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eef88-33d9-4b69-981f-e76543960804 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:17.913458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574231fa-8584-48b8-8990-45c4f9c147e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:17.917231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574231fa-8584-48b8-8990-45c4f9c147e1 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:17.960057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 833/1652] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:18.069008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:18.071677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:18.071677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:18.071677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] PATH_INFO: `/v3/users/70235495a2a24424b91b21d644f04f00` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:18.072477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70235495a2a24424b91b21d644f04f00)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:18.074637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:18.193642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70235495a2a24424b91b21d644f04f00'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:18.195203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70235495a2a24424b91b21d644f04f00'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:18.219177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70235495a2a24424b91b21d644f04f00'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:18.240119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70235495a2a24424b91b21d644f04f00'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:18.245480 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70235495a2a24424b91b21d644f04f00'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:18.317940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc4968-7f88-45e3-a656-eb4c484e75ff None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:18.319534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc4968-7f88-45e3-a656-eb4c484e75ff None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:18.319534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc4968-7f88-45e3-a656-eb4c484e75ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:18.319720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 820/1653] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:17 2022] DELETE /identity/v3/users/70235495a2a24424b91b21d644f04f00 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:07:18.355962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c1cc4968-7f88-45e3-a656-eb4c484e75ff None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:18.359934 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c1cc4968-7f88-45e3-a656-eb4c484e75ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:18.462130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 834/1654] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:18.508433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:18.510084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:18.583123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:18.657326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc0a80-946c-4b6a-a139-69f77cf212a5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:18.667092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faa102-da9c-41fe-8f48-3df6f90a514c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:18.667772 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faa102-da9c-41fe-8f48-3df6f90a514c service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:18.668058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faa102-da9c-41fe-8f48-3df6f90a514c service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:18.668367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faa102-da9c-41fe-8f48-3df6f90a514c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:18.693581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faa102-da9c-41fe-8f48-3df6f90a514c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:18.697965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45faa102-da9c-41fe-8f48-3df6f90a514c service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:18.724505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 821/1655] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:21.061604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc4968-7f88-45e3-a656-eb4c484e75ff None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:21.063080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c1cc4968-7f88-45e3-a656-eb4c484e75ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:21.086921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc4968-7f88-45e3-a656-eb4c484e75ff None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:21.102088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:21.103784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:21.104307 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:21.104813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] PATH_INFO: `/v3/projects/3a69427b7d2142fa9531282f59892f70` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:21.109007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a69427b7d2142fa9531282f59892f70)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:21.111770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:21.263936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a69427b7d2142fa9531282f59892f70', 'request_id': 'req-eccf898e-9d64-4550-96a3-0edf6c09310c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:21.273335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a69427b7d2142fa9531282f59892f70', 'request_id': 'req-eccf898e-9d64-4550-96a3-0edf6c09310c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:21.282658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a69427b7d2142fa9531282f59892f70', 'request_id': 'req-eccf898e-9d64-4550-96a3-0edf6c09310c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:21.302914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] The token cache is being invalidate because project 3a69427b7d2142fa9531282f59892f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:21.303567 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:21.304579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eccf898e-9d64-4550-96a3-0edf6c09310c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:21.306811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 835/1656] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:21 2022] DELETE /identity/v3/projects/3a69427b7d2142fa9531282f59892f70 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:21.312068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520f6d5-df33-4b3d-8743-a0b387310952 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:21.314120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520f6d5-df33-4b3d-8743-a0b387310952 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:21.314842 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520f6d5-df33-4b3d-8743-a0b387310952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:21.353070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2520f6d5-df33-4b3d-8743-a0b387310952 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:21.354951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2520f6d5-df33-4b3d-8743-a0b387310952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:21.505387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 822/1657] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:21.514584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3be4b-d960-41cf-b1c1-cfe38577d263 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:21.515133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3be4b-d960-41cf-b1c1-cfe38577d263 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:21.515629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3be4b-d960-41cf-b1c1-cfe38577d263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:21.552593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-47d3be4b-d960-41cf-b1c1-cfe38577d263 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:21.557867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-47d3be4b-d960-41cf-b1c1-cfe38577d263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:21.588638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 836/1658] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:21.592587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520f6d5-df33-4b3d-8743-a0b387310952 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:21.608811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520f6d5-df33-4b3d-8743-a0b387310952 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:21.627505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdf8fc-f097-4071-a285-16fd98a8b604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:21.628588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdf8fc-f097-4071-a285-16fd98a8b604 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:21.629279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdf8fc-f097-4071-a285-16fd98a8b604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:21.629749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdf8fc-f097-4071-a285-16fd98a8b604 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:21.630748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdf8fc-f097-4071-a285-16fd98a8b604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:21.631567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdf8fc-f097-4071-a285-16fd98a8b604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:21.636717 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdf8fc-f097-4071-a285-16fd98a8b604 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:21.667216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 823/1659] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:21.672721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3be4b-d960-41cf-b1c1-cfe38577d263 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:21.682422 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdf8fc-f097-4071-a285-16fd98a8b604 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:21.684272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f2cdf8fc-f097-4071-a285-16fd98a8b604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:21.699845 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3be4b-d960-41cf-b1c1-cfe38577d263 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:21.722115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdf8fc-f097-4071-a285-16fd98a8b604 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:21.730963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6629c-44a6-4412-9ba4-cdfbf4ee67d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:21.734916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6629c-44a6-4412-9ba4-cdfbf4ee67d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:21.736281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6629c-44a6-4412-9ba4-cdfbf4ee67d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:21.737089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6629c-44a6-4412-9ba4-cdfbf4ee67d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:21.737773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:21.738886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:21.739273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:21.739864 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] PATH_INFO: `/v3/projects/0bf36fa447dd4c1e937913c9b8fa3e72` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:21.740394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6629c-44a6-4412-9ba4-cdfbf4ee67d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:21.745476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6629c-44a6-4412-9ba4-cdfbf4ee67d5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:21.746126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf36fa447dd4c1e937913c9b8fa3e72)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:21.749101 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:21.837964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 837/1660] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:21 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:21.840281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6629c-44a6-4412-9ba4-cdfbf4ee67d5 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:21.847793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf36fa447dd4c1e937913c9b8fa3e72', 'request_id': 'req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:21.860207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf36fa447dd4c1e937913c9b8fa3e72', 'request_id': 'req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:21.872655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf36fa447dd4c1e937913c9b8fa3e72', 'request_id': 'req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:21.886060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:21.891988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] The token cache is being invalidate because project 0bf36fa447dd4c1e937913c9b8fa3e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:21.892636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:21.894292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6a8b2b09-a3e0-49a3-9034-5d20cf5c2d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:21.899345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 824/1661] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:21 2022] DELETE /identity/v3/projects/0bf36fa447dd4c1e937913c9b8fa3e72 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:21.906883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899143-6f73-496c-b0f6-2186f9356ff1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:21.907480 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899143-6f73-496c-b0f6-2186f9356ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:21.907942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53899143-6f73-496c-b0f6-2186f9356ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:21.965263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-53899143-6f73-496c-b0f6-2186f9356ff1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:21.970482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-53899143-6f73-496c-b0f6-2186f9356ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:22.051996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:22.072720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6629c-44a6-4412-9ba4-cdfbf4ee67d5 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:22.095177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200d490-0818-4d62-a0b5-14d16c1d41d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:22.097309 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200d490-0818-4d62-a0b5-14d16c1d41d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.097867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200d490-0818-4d62-a0b5-14d16c1d41d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.099405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200d490-0818-4d62-a0b5-14d16c1d41d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:22.100227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200d490-0818-4d62-a0b5-14d16c1d41d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:22.104150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200d490-0818-4d62-a0b5-14d16c1d41d4 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:22.125741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 825/1662] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:22.132633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc84864-c755-4dc3-81d9-07ddf89db71e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.133054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc84864-c755-4dc3-81d9-07ddf89db71e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.133610 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc84864-c755-4dc3-81d9-07ddf89db71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:22.166231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 838/1663] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:21 2022] POST /identity/v3/users => generated 291 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:22.168965 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200d490-0818-4d62-a0b5-14d16c1d41d4 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:22.175447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2200d490-0818-4d62-a0b5-14d16c1d41d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:22.194209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ccc84864-c755-4dc3-81d9-07ddf89db71e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:22.197210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ccc84864-c755-4dc3-81d9-07ddf89db71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:22.203550 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200d490-0818-4d62-a0b5-14d16c1d41d4 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:22.219346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 826/1664] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:22.220573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc84864-c755-4dc3-81d9-07ddf89db71e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:22.221503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743470cd-0335-44aa-8faf-7cec45f70a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:22.222148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743470cd-0335-44aa-8faf-7cec45f70a6d admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.222534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743470cd-0335-44aa-8faf-7cec45f70a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.222922 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743470cd-0335-44aa-8faf-7cec45f70a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:22.225195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743470cd-0335-44aa-8faf-7cec45f70a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:22.233835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743470cd-0335-44aa-8faf-7cec45f70a6d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:22.256708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc84864-c755-4dc3-81d9-07ddf89db71e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:22.265527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b65fa8-8178-41d2-b7c6-b14ac6955f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:22.266401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65fa8-8178-41d2-b7c6-b14ac6955f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.266989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65fa8-8178-41d2-b7c6-b14ac6955f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.267381 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65fa8-8178-41d2-b7c6-b14ac6955f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:22.268965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b65fa8-8178-41d2-b7c6-b14ac6955f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:22.270246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b65fa8-8178-41d2-b7c6-b14ac6955f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:22.270514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 839/1665] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:22.274896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743470cd-0335-44aa-8faf-7cec45f70a6d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:22.278031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b65fa8-8178-41d2-b7c6-b14ac6955f60 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:22.297601 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 827/1666] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:22.301878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b65fa8-8178-41d2-b7c6-b14ac6955f60 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:22.307668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743470cd-0335-44aa-8faf-7cec45f70a6d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:22.323852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb1f50-670f-4484-a783-54732ae8bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:22.324663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1f50-670f-4484-a783-54732ae8bb83 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.324960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1f50-670f-4484-a783-54732ae8bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.325241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1f50-670f-4484-a783-54732ae8bb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:22.326529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb1f50-670f-4484-a783-54732ae8bb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:22.330888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb1f50-670f-4484-a783-54732ae8bb83 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:22.344598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b65fa8-8178-41d2-b7c6-b14ac6955f60 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:22.355898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ecc86-bf84-41b1-b302-10cf456b1bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:22.357996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ecc86-bf84-41b1-b302-10cf456b1bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.359658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ecc86-bf84-41b1-b302-10cf456b1bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.360293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ecc86-bf84-41b1-b302-10cf456b1bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:22.362206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ecc86-bf84-41b1-b302-10cf456b1bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:22.367790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ecc86-bf84-41b1-b302-10cf456b1bcc admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:22.368882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 840/1667] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:22.369797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb1f50-670f-4484-a783-54732ae8bb83 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:22.380108 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f4fb1f50-670f-4484-a783-54732ae8bb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:22.411405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb1f50-670f-4484-a783-54732ae8bb83 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:22.426672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:22.427736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.428271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.428792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] PATH_INFO: `/v3/projects/a455398f7d314c3d8accd373e4fa24de` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:22.431885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a455398f7d314c3d8accd373e4fa24de)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:22.434710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:22.437385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 828/1668] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:22 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:22.438953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ecc86-bf84-41b1-b302-10cf456b1bcc admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:22.550150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a455398f7d314c3d8accd373e4fa24de', 'request_id': 'req-8f753fa7-dac7-43ba-90bc-e25e87142c58'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:22.564694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a455398f7d314c3d8accd373e4fa24de', 'request_id': 'req-8f753fa7-dac7-43ba-90bc-e25e87142c58'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:22.576784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a455398f7d314c3d8accd373e4fa24de', 'request_id': 'req-8f753fa7-dac7-43ba-90bc-e25e87142c58'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:22.611822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] The token cache is being invalidate because project a455398f7d314c3d8accd373e4fa24de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:22.612394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:22.613250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:22.615011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 841/1669] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:22 2022] DELETE /identity/v3/projects/a455398f7d314c3d8accd373e4fa24de => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:22.617781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ecc86-bf84-41b1-b302-10cf456b1bcc admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:22.620225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:22.624355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:22.773024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f753fa7-dac7-43ba-90bc-e25e87142c58 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:22.775781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1af6d8-ed81-4657-812e-e5570ed3b3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:22.776854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1af6d8-ed81-4657-812e-e5570ed3b3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.777217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1af6d8-ed81-4657-812e-e5570ed3b3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.777566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1af6d8-ed81-4657-812e-e5570ed3b3ec admin admin] PATH_INFO: `/v3/projects/17c4965e102940b194bc60c13ceaa32e/users/37a8d56e57b9407ca77ac9ee58bc0c1f/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:22.795762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e613db8-bb56-4d81-97de-21acec718f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:22.796565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e613db8-bb56-4d81-97de-21acec718f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.799907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e613db8-bb56-4d81-97de-21acec718f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.800327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e613db8-bb56-4d81-97de-21acec718f4f admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:22.802082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e613db8-bb56-4d81-97de-21acec718f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:22.805925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e613db8-bb56-4d81-97de-21acec718f4f admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:22.817335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:22.819225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1af6d8-ed81-4657-812e-e5570ed3b3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c4965e102940b194bc60c13ceaa32e, user_id=37a8d56e57b9407ca77ac9ee58bc0c1f, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:22.822361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1af6d8-ed81-4657-812e-e5570ed3b3ec admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:22.839793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 842/1670] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:22 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:22.840890 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 829/1671] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:22 2022] PUT /identity/v3/projects/17c4965e102940b194bc60c13ceaa32e/users/37a8d56e57b9407ca77ac9ee58bc0c1f/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:22.841864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e613db8-bb56-4d81-97de-21acec718f4f admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:22.844748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1af6d8-ed81-4657-812e-e5570ed3b3ec admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:22.846986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0e613db8-bb56-4d81-97de-21acec718f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:22.870977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e613db8-bb56-4d81-97de-21acec718f4f admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:22.888006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:22.951270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1af6d8-ed81-4657-812e-e5570ed3b3ec admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:22.958605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bbbef-9e4e-467f-8635-0d29800def33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:22.959571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bbbef-9e4e-467f-8635-0d29800def33 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.959952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bbbef-9e4e-467f-8635-0d29800def33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.960353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bbbef-9e4e-467f-8635-0d29800def33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:22.961223 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bbbef-9e4e-467f-8635-0d29800def33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:22.963195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bbbef-9e4e-467f-8635-0d29800def33 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:22.966247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:22.967479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.968175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.968493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] PATH_INFO: `/v3/users/e9f6a506edc048c8896ada008b69d1a3` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:22.972263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f6a506edc048c8896ada008b69d1a3)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:22.978560 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 830/1672] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:07:22.978730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:22.978832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeca53-f9e9-4ff0-af04-83c921a1c82b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:22.978832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeca53-f9e9-4ff0-af04-83c921a1c82b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:22.978832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eeca53-f9e9-4ff0-af04-83c921a1c82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.008116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b2eeca53-f9e9-4ff0-af04-83c921a1c82b None None] MFA Rules not processed for user `37a8d56e57b9407ca77ac9ee58bc0c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:23.009649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b2eeca53-f9e9-4ff0-af04-83c921a1c82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:23.064377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f6a506edc048c8896ada008b69d1a3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:23.074000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f6a506edc048c8896ada008b69d1a3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:23.074729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f6a506edc048c8896ada008b69d1a3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:23.076346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f6a506edc048c8896ada008b69d1a3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:23.090761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 831/1673] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:23.092354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eeca53-f9e9-4ff0-af04-83c921a1c82b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:23.102579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f6a506edc048c8896ada008b69d1a3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:23.106460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eeca53-f9e9-4ff0-af04-83c921a1c82b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:23.114135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3fb6f-6b2b-4eb4-a225-a590f5dc6f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:23.115050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3fb6f-6b2b-4eb4-a225-a590f5dc6f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:23.115690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3fb6f-6b2b-4eb4-a225-a590f5dc6f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:23.115889 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3fb6f-6b2b-4eb4-a225-a590f5dc6f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.116895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3fb6f-6b2b-4eb4-a225-a590f5dc6f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:23.118896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3fb6f-6b2b-4eb4-a225-a590f5dc6f6d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:23.124760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 843/1674] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:22 2022] DELETE /identity/v3/users/e9f6a506edc048c8896ada008b69d1a3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:23.125964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:23.127997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:23.133575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 832/1675] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:23.134735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3fb6f-6b2b-4eb4-a225-a590f5dc6f6d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:23.136622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dfe3fb6f-6b2b-4eb4-a225-a590f5dc6f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:23.154180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3fb6f-6b2b-4eb4-a225-a590f5dc6f6d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:23.315075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a70dc-7667-4e7f-bd1e-cb3c1b8abb1c admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:23.336476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1766ed6-13ef-4922-8d02-7e7cc700b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:23.338887 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1766ed6-13ef-4922-8d02-7e7cc700b355 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:23.339085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1766ed6-13ef-4922-8d02-7e7cc700b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:23.339465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1766ed6-13ef-4922-8d02-7e7cc700b355 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.340257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1766ed6-13ef-4922-8d02-7e7cc700b355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:23.345744 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1766ed6-13ef-4922-8d02-7e7cc700b355 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:23.349025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ca059-edab-4ca4-8ca1-b57f4e1eece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:23.351481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ca059-edab-4ca4-8ca1-b57f4e1eece2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:23.356073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ca059-edab-4ca4-8ca1-b57f4e1eece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:23.356618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ca059-edab-4ca4-8ca1-b57f4e1eece2 admin admin] PATH_INFO: `/v3/projects/f270c5913c4e495e9fbc809239b421db/users/cf89618b442b465f9ee8c86278bd4146/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.388835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ca059-edab-4ca4-8ca1-b57f4e1eece2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f270c5913c4e495e9fbc809239b421db, user_id=cf89618b442b465f9ee8c86278bd4146, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:23.392923 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ca059-edab-4ca4-8ca1-b57f4e1eece2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:23.398693 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:23.411172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 844/1676] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:23 2022] POST /identity/v3/projects => generated 381 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:23.413582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b2c12-5f92-4b2b-830d-b308ab049a09 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:23.414076 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b2c12-5f92-4b2b-830d-b308ab049a09 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:23.415116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b2c12-5f92-4b2b-830d-b308ab049a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.442635 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 833/1677] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:23 2022] PUT /identity/v3/projects/f270c5913c4e495e9fbc809239b421db/users/cf89618b442b465f9ee8c86278bd4146/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:23.457942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ca059-edab-4ca4-8ca1-b57f4e1eece2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:23.510402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b81b2c12-5f92-4b2b-830d-b308ab049a09 None None] MFA Rules not processed for user `6bad8a4de2c84319a8601e7625c2655e`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:23.511675 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b81b2c12-5f92-4b2b-830d-b308ab049a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:23.570730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:23.698655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ca059-edab-4ca4-8ca1-b57f4e1eece2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:23.710227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 845/1678] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:23.713656 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cb596-b575-454d-9bfb-46ae4eb0aad9 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:23.713957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cb596-b575-454d-9bfb-46ae4eb0aad9 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:23.714239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cb596-b575-454d-9bfb-46ae4eb0aad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.721706 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2baff1a-5961-436e-9e23-a57667bf5e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:23.722397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baff1a-5961-436e-9e23-a57667bf5e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:23.722679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baff1a-5961-436e-9e23-a57667bf5e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:23.725740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baff1a-5961-436e-9e23-a57667bf5e91 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.726471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2baff1a-5961-436e-9e23-a57667bf5e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:23.731163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2baff1a-5961-436e-9e23-a57667bf5e91 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:23.774970 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 834/1679] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:23 2022] POST /identity/v3/users => generated 297 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:23.775703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2baff1a-5961-436e-9e23-a57667bf5e91 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:23.780736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c2baff1a-5961-436e-9e23-a57667bf5e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:23.794081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-2d3cb596-b575-454d-9bfb-46ae4eb0aad9 None None] MFA Rules not processed for user `cf89618b442b465f9ee8c86278bd4146`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:23.796356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2d3cb596-b575-454d-9bfb-46ae4eb0aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:23.950742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2baff1a-5961-436e-9e23-a57667bf5e91 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:23.957317 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 846/1680] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:23.958131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cb596-b575-454d-9bfb-46ae4eb0aad9 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:23.964843 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1f007-59d7-4c69-a49e-293fcd6ece7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:23.965404 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f007-59d7-4c69-a49e-293fcd6ece7a service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:23.965690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f007-59d7-4c69-a49e-293fcd6ece7a service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:23.965965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1f007-59d7-4c69-a49e-293fcd6ece7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:23.985741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1f007-59d7-4c69-a49e-293fcd6ece7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:23.986556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cb596-b575-454d-9bfb-46ae4eb0aad9 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:23.987368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1f007-59d7-4c69-a49e-293fcd6ece7a service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.002763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442b056-a7ff-464c-bef2-456aa37fff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.003450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b056-a7ff-464c-bef2-456aa37fff9e admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.003739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b056-a7ff-464c-bef2-456aa37fff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.004018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442b056-a7ff-464c-bef2-456aa37fff9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.004795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442b056-a7ff-464c-bef2-456aa37fff9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.006659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442b056-a7ff-464c-bef2-456aa37fff9e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.018080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 835/1681] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:24.019064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1f007-59d7-4c69-a49e-293fcd6ece7a service nova] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.024580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-87b1f007-59d7-4c69-a49e-293fcd6ece7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.031480 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 847/1682] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:24.035554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442b056-a7ff-464c-bef2-456aa37fff9e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.055644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1f007-59d7-4c69-a49e-293fcd6ece7a service nova] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.057095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442b056-a7ff-464c-bef2-456aa37fff9e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.070668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4302e-cebd-45ba-9b21-7e82deb182c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.071706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4302e-cebd-45ba-9b21-7e82deb182c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.071989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4302e-cebd-45ba-9b21-7e82deb182c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.072265 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4302e-cebd-45ba-9b21-7e82deb182c1 admin admin] PATH_INFO: `/v3/projects/00da2c378ab54d8eafe30f1a3d0eaad6/users/c6e93d9c11144e29ad6ecb85a50f7e62/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.073707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ecd3d-3aa8-4f40-8f60-3a217f898fe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.074527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ecd3d-3aa8-4f40-8f60-3a217f898fe5 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.074638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ecd3d-3aa8-4f40-8f60-3a217f898fe5 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.074918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ecd3d-3aa8-4f40-8f60-3a217f898fe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.094281 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ecd3d-3aa8-4f40-8f60-3a217f898fe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.096474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ecd3d-3aa8-4f40-8f60-3a217f898fe5 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.110835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4302e-cebd-45ba-9b21-7e82deb182c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00da2c378ab54d8eafe30f1a3d0eaad6, user_id=c6e93d9c11144e29ad6ecb85a50f7e62, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.113869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4302e-cebd-45ba-9b21-7e82deb182c1 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.119450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 836/1683] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:24.146564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 848/1684] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:24 2022] PUT /identity/v3/projects/00da2c378ab54d8eafe30f1a3d0eaad6/users/c6e93d9c11144e29ad6ecb85a50f7e62/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:24.147802 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ecd3d-3aa8-4f40-8f60-3a217f898fe5 service nova] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.173304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ecd3d-3aa8-4f40-8f60-3a217f898fe5 service nova] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.405255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b400119-fbe9-4334-8d5a-c3b53e5cf8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.406737 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400119-fbe9-4334-8d5a-c3b53e5cf8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.407248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400119-fbe9-4334-8d5a-c3b53e5cf8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.407721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b400119-fbe9-4334-8d5a-c3b53e5cf8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.408696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b400119-fbe9-4334-8d5a-c3b53e5cf8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.410565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b400119-fbe9-4334-8d5a-c3b53e5cf8e0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.455368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 837/1685] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:24.456097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4302e-cebd-45ba-9b21-7e82deb182c1 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.470441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4302e-cebd-45ba-9b21-7e82deb182c1 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.489332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481430e-7b56-4f48-bfef-af347c396995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.490259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481430e-7b56-4f48-bfef-af347c396995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.490545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481430e-7b56-4f48-bfef-af347c396995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.490822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481430e-7b56-4f48-bfef-af347c396995 admin admin] PATH_INFO: `/v3/projects/00da2c378ab54d8eafe30f1a3d0eaad6/users/c6e93d9c11144e29ad6ecb85a50f7e62/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.494170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481430e-7b56-4f48-bfef-af347c396995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00da2c378ab54d8eafe30f1a3d0eaad6, user_id=c6e93d9c11144e29ad6ecb85a50f7e62, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.497542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481430e-7b56-4f48-bfef-af347c396995 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.523457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 849/1686] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:24 2022] PUT /identity/v3/projects/00da2c378ab54d8eafe30f1a3d0eaad6/users/c6e93d9c11144e29ad6ecb85a50f7e62/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:24.534756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b400119-fbe9-4334-8d5a-c3b53e5cf8e0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.540182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1eb20-9d2c-4341-8d8c-c4158cc897a7 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.540182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1eb20-9d2c-4341-8d8c-c4158cc897a7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.540182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1eb20-9d2c-4341-8d8c-c4158cc897a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.556936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b400119-fbe9-4334-8d5a-c3b53e5cf8e0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.605185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-16b1eb20-9d2c-4341-8d8c-c4158cc897a7 None None] MFA Rules not processed for user `c6e93d9c11144e29ad6ecb85a50f7e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:24.608092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-16b1eb20-9d2c-4341-8d8c-c4158cc897a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.610650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:24.633888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:24.694301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.704205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.704915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.705436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] PATH_INFO: `/v3/users/cf89618b442b465f9ee8c86278bd4146` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.707959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf89618b442b465f9ee8c86278bd4146)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.710640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.795689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 850/1687] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:24.797946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1eb20-9d2c-4341-8d8c-c4158cc897a7 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.809360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-16b1eb20-9d2c-4341-8d8c-c4158cc897a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.819397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf89618b442b465f9ee8c86278bd4146'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.824402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf89618b442b465f9ee8c86278bd4146'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.845732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf89618b442b465f9ee8c86278bd4146'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.847899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1eb20-9d2c-4341-8d8c-c4158cc897a7 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:24.856113 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367995f-ffb0-47ac-9056-461b83c8ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:24.857417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367995f-ffb0-47ac-9056-461b83c8ab7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:24.857915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367995f-ffb0-47ac-9056-461b83c8ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:24.861481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367995f-ffb0-47ac-9056-461b83c8ab7a admin admin] PATH_INFO: `/v3/users/3697157da50f43a687a0e9610f801fbb` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:24.863518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367995f-ffb0-47ac-9056-461b83c8ab7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3697157da50f43a687a0e9610f801fbb)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:24.864113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf89618b442b465f9ee8c86278bd4146'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.864806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf89618b442b465f9ee8c86278bd4146'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.871906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367995f-ffb0-47ac-9056-461b83c8ab7a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:24.914540 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 838/1688] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:24 2022] DELETE /identity/v3/users/cf89618b442b465f9ee8c86278bd4146 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:24.915421 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:24.919310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:24.976795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b367995f-ffb0-47ac-9056-461b83c8ab7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3697157da50f43a687a0e9610f801fbb'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.991526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b367995f-ffb0-47ac-9056-461b83c8ab7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3697157da50f43a687a0e9610f801fbb'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.996908 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b367995f-ffb0-47ac-9056-461b83c8ab7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3697157da50f43a687a0e9610f801fbb'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:24.998602 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b367995f-ffb0-47ac-9056-461b83c8ab7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3697157da50f43a687a0e9610f801fbb'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.045682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b367995f-ffb0-47ac-9056-461b83c8ab7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3697157da50f43a687a0e9610f801fbb'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.074739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 851/1689] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:24 2022] DELETE /identity/v3/users/3697157da50f43a687a0e9610f801fbb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:25.084290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080de86-de99-4c6a-aa20-335bc2434ec0 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:25.084711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080de86-de99-4c6a-aa20-335bc2434ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:25.084993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080de86-de99-4c6a-aa20-335bc2434ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:25.103554 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a614d3-ec59-498a-b3c9-10fad799885a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:25.144282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-1080de86-de99-4c6a-aa20-335bc2434ec0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:25.146331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1080de86-de99-4c6a-aa20-335bc2434ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.221172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5db77d-2aff-462a-9b1a-e5d1b6f83038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:25.221851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5db77d-2aff-462a-9b1a-e5d1b6f83038 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:25.222145 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5db77d-2aff-462a-9b1a-e5d1b6f83038 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:25.222416 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5db77d-2aff-462a-9b1a-e5d1b6f83038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:25.228367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6e5db77d-2aff-462a-9b1a-e5d1b6f83038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.234224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 852/1690] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:25.234701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63c4f7-7f77-461b-8b56-03b48108af10 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:25.235061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63c4f7-7f77-461b-8b56-03b48108af10 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:25.235447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63c4f7-7f77-461b-8b56-03b48108af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:25.256062 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:25.262580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-0d63c4f7-7f77-461b-8b56-03b48108af10 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:25.264998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0d63c4f7-7f77-461b-8b56-03b48108af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.291997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 853/1691] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:25.293240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63c4f7-7f77-461b-8b56-03b48108af10 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:25.300155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0d63c4f7-7f77-461b-8b56-03b48108af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.337132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63c4f7-7f77-461b-8b56-03b48108af10 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:25.348988 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:25.350686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:25.350973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:25.352376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] PATH_INFO: `/v3/projects/53ba89a5fe684cff815af90ac2e20b93` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:25.358691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ba89a5fe684cff815af90ac2e20b93)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:25.363271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:25.363417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5db77d-2aff-462a-9b1a-e5d1b6f83038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:25.364876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5db77d-2aff-462a-9b1a-e5d1b6f83038 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:25.388636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 839/1692] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:25.430301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5db77d-2aff-462a-9b1a-e5d1b6f83038 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:25.431940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6e5db77d-2aff-462a-9b1a-e5d1b6f83038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.453366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:25.561886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5db77d-2aff-462a-9b1a-e5d1b6f83038 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:25.591630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ba89a5fe684cff815af90ac2e20b93', 'request_id': 'req-15be11cd-7a1f-4cbd-a9fb-e037a116827f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.617171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ba89a5fe684cff815af90ac2e20b93', 'request_id': 'req-15be11cd-7a1f-4cbd-a9fb-e037a116827f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.638185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ba89a5fe684cff815af90ac2e20b93', 'request_id': 'req-15be11cd-7a1f-4cbd-a9fb-e037a116827f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.680639 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] The token cache is being invalidate because project 53ba89a5fe684cff815af90ac2e20b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:25.683645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.687356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:25.691889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 854/1693] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:25 2022] DELETE /identity/v3/projects/53ba89a5fe684cff815af90ac2e20b93 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:25.695206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:25.699352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.712492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab0f9e-d6da-43a4-80fc-2be0d2b7de7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:25.713175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0f9e-d6da-43a4-80fc-2be0d2b7de7e service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:25.713464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0f9e-d6da-43a4-80fc-2be0d2b7de7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:25.713743 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab0f9e-d6da-43a4-80fc-2be0d2b7de7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:25.719104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5dab0f9e-d6da-43a4-80fc-2be0d2b7de7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.742583 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be11cd-7a1f-4cbd-a9fb-e037a116827f admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:25.760893 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ebe5a-a8e8-42b4-b661-94b9e1c7230d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:25.761579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ebe5a-a8e8-42b4-b661-94b9e1c7230d service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:25.761867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ebe5a-a8e8-42b4-b661-94b9e1c7230d service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:25.762144 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ebe5a-a8e8-42b4-b661-94b9e1c7230d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:25.773432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f07ebe5a-a8e8-42b4-b661-94b9e1c7230d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.918195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab0f9e-d6da-43a4-80fc-2be0d2b7de7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:25.924925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab0f9e-d6da-43a4-80fc-2be0d2b7de7e service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:25.953190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 840/1694] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:25.954080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab0f9e-d6da-43a4-80fc-2be0d2b7de7e service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:25.961667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5dab0f9e-d6da-43a4-80fc-2be0d2b7de7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:25.989531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ebe5a-a8e8-42b4-b661-94b9e1c7230d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:25.990921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ebe5a-a8e8-42b4-b661-94b9e1c7230d service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:26.020518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:26.023887 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 855/1695] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:26.031748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf1b3-0499-46f2-aa37-809793761dee None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:26.032266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf1b3-0499-46f2-aa37-809793761dee None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:26.032740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bf1b3-0499-46f2-aa37-809793761dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:26.097877 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-e27bf1b3-0499-46f2-aa37-809793761dee None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:26.099156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e27bf1b3-0499-46f2-aa37-809793761dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:26.135905 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 856/1696] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:26.137613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1091a70-c17d-4d9f-8d04-f90bc42b17eb None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:26.141747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1091a70-c17d-4d9f-8d04-f90bc42b17eb None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:26.142209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1091a70-c17d-4d9f-8d04-f90bc42b17eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:26.168568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab0f9e-d6da-43a4-80fc-2be0d2b7de7e service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:26.182807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a58df-328c-4dfa-8245-4aa881fc2c83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:26.183481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a58df-328c-4dfa-8245-4aa881fc2c83 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:26.183996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a58df-328c-4dfa-8245-4aa881fc2c83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:26.184132 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a58df-328c-4dfa-8245-4aa881fc2c83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:26.187091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a20a58df-328c-4dfa-8245-4aa881fc2c83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:26.208940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-f1091a70-c17d-4d9f-8d04-f90bc42b17eb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:26.210735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f1091a70-c17d-4d9f-8d04-f90bc42b17eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:26.256504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 857/1697] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:26.256504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1091a70-c17d-4d9f-8d04-f90bc42b17eb None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:26.266165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1091a70-c17d-4d9f-8d04-f90bc42b17eb None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:26.284195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6cf6b8-3416-4281-b738-7744fa0e6ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:26.284917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf6b8-3416-4281-b738-7744fa0e6ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:26.285616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf6b8-3416-4281-b738-7744fa0e6ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:26.285616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6cf6b8-3416-4281-b738-7744fa0e6ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:26.286211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cf6b8-3416-4281-b738-7744fa0e6ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:26.286525 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cf6b8-3416-4281-b738-7744fa0e6ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:26.288151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6cf6b8-3416-4281-b738-7744fa0e6ee5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:26.323402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 858/1698] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:07:26.323402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67f5c2-47c9-44df-8be4-3711ce652de9 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:26.323402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67f5c2-47c9-44df-8be4-3711ce652de9 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:26.323402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67f5c2-47c9-44df-8be4-3711ce652de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:26.330820 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a58df-328c-4dfa-8245-4aa881fc2c83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:26.332459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a58df-328c-4dfa-8245-4aa881fc2c83 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:26.351913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 841/1699] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:26.365500 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a58df-328c-4dfa-8245-4aa881fc2c83 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:26.396514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-fd67f5c2-47c9-44df-8be4-3711ce652de9 None None] MFA Rules not processed for user `c2b89a9466d848529893af51e99be1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:26.397761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-fd67f5c2-47c9-44df-8be4-3711ce652de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:26.402529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a58df-328c-4dfa-8245-4aa881fc2c83 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:26.427284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feb9d1-6018-4d60-bfe1-b3242d4c754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:26.427994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feb9d1-6018-4d60-bfe1-b3242d4c754d admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:26.428539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feb9d1-6018-4d60-bfe1-b3242d4c754d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:26.428996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87feb9d1-6018-4d60-bfe1-b3242d4c754d admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:26.429939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87feb9d1-6018-4d60-bfe1-b3242d4c754d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:26.432057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87feb9d1-6018-4d60-bfe1-b3242d4c754d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:26.515614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 842/1700] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:26 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:26.518040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feb9d1-6018-4d60-bfe1-b3242d4c754d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:26.639391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:26.658666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 859/1701] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:26.677907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67f5c2-47c9-44df-8be4-3711ce652de9 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:26.680292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-fd67f5c2-47c9-44df-8be4-3711ce652de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:26.791037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87feb9d1-6018-4d60-bfe1-b3242d4c754d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:26.808536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256903d6-1127-4cda-b74f-abdcf24424fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:26.809424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256903d6-1127-4cda-b74f-abdcf24424fb admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:26.809773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256903d6-1127-4cda-b74f-abdcf24424fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:26.810057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256903d6-1127-4cda-b74f-abdcf24424fb admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:26.810764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256903d6-1127-4cda-b74f-abdcf24424fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:26.826878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256903d6-1127-4cda-b74f-abdcf24424fb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:26.895477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 843/1702] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:26 2022] POST /identity/v3/users => generated 289 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:26.896945 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256903d6-1127-4cda-b74f-abdcf24424fb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:26.931681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256903d6-1127-4cda-b74f-abdcf24424fb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:26.973254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67f5c2-47c9-44df-8be4-3711ce652de9 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:26.978530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa34a05-5c6e-448e-b0dc-ae5071a41a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:26.978530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa34a05-5c6e-448e-b0dc-ae5071a41a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:26.980950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa34a05-5c6e-448e-b0dc-ae5071a41a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:26.981249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa34a05-5c6e-448e-b0dc-ae5071a41a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:26.982068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa34a05-5c6e-448e-b0dc-ae5071a41a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:26.983713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa34a05-5c6e-448e-b0dc-ae5071a41a2c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:27.011586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 844/1703] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:27.012511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa34a05-5c6e-448e-b0dc-ae5071a41a2c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:27.054838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa34a05-5c6e-448e-b0dc-ae5071a41a2c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:27.072330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf9317-8908-4a68-b097-450321f7e23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:27.073020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf9317-8908-4a68-b097-450321f7e23b admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:27.073299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf9317-8908-4a68-b097-450321f7e23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:27.073572 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf9317-8908-4a68-b097-450321f7e23b admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:27.074307 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf9317-8908-4a68-b097-450321f7e23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:27.075992 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf9317-8908-4a68-b097-450321f7e23b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:27.155693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 845/1704] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:27.160607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf9317-8908-4a68-b097-450321f7e23b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:27.190564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf9317-8908-4a68-b097-450321f7e23b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:27.220259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51ed61-3985-4655-9360-7ffb71fef5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:27.223278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51ed61-3985-4655-9360-7ffb71fef5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:27.223278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51ed61-3985-4655-9360-7ffb71fef5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:27.223475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51ed61-3985-4655-9360-7ffb71fef5e9 admin admin] PATH_INFO: `/v3/projects/0fd944b5382a42d18cb7f8bdf22b461a/users/d70cb37ab9944b26a4d56d334da95749/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:27.226241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df544853-5872-4572-8284-6b5fbe318e42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:27.228211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df544853-5872-4572-8284-6b5fbe318e42 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:27.228630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df544853-5872-4572-8284-6b5fbe318e42 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:27.229232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df544853-5872-4572-8284-6b5fbe318e42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:27.266362 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:27.279280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51ed61-3985-4655-9360-7ffb71fef5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd944b5382a42d18cb7f8bdf22b461a, user_id=d70cb37ab9944b26a4d56d334da95749, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:27.282299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51ed61-3985-4655-9360-7ffb71fef5e9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:27.327122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 846/1705] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:27 2022] PUT /identity/v3/projects/0fd944b5382a42d18cb7f8bdf22b461a/users/d70cb37ab9944b26a4d56d334da95749/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:27.337312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d7acb-7e7d-4b2a-b5d7-c713b623e909 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:27.337716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d7acb-7e7d-4b2a-b5d7-c713b623e909 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:27.338148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d7acb-7e7d-4b2a-b5d7-c713b623e909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:27.421104 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df544853-5872-4572-8284-6b5fbe318e42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:27.423529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df544853-5872-4572-8284-6b5fbe318e42 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:27.457319 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a03d7acb-7e7d-4b2a-b5d7-c713b623e909 None None] MFA Rules not processed for user `d70cb37ab9944b26a4d56d334da95749`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:27.460892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a03d7acb-7e7d-4b2a-b5d7-c713b623e909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:27.462261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 860/1706] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 787 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:07:27.698240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 847/1707] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:27.699194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df544853-5872-4572-8284-6b5fbe318e42 service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:27.720957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df544853-5872-4572-8284-6b5fbe318e42 service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:27.801193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:27.839494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9170b0-1f43-470b-a66e-36a88325f2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:27.841492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9170b0-1f43-470b-a66e-36a88325f2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:27.841926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9170b0-1f43-470b-a66e-36a88325f2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:27.842346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9170b0-1f43-470b-a66e-36a88325f2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:27.843202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9170b0-1f43-470b-a66e-36a88325f2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:27.846842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9170b0-1f43-470b-a66e-36a88325f2f3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:27.900278 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 861/1708] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:27 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:07:27.904842 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d7acb-7e7d-4b2a-b5d7-c713b623e909 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:27.925649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d7acb-7e7d-4b2a-b5d7-c713b623e909 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:28.121181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f736468-d4c3-4abc-941d-03f2bfd8aa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:28.122565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f736468-d4c3-4abc-941d-03f2bfd8aa78 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:28.122966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f736468-d4c3-4abc-941d-03f2bfd8aa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:28.123351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f736468-d4c3-4abc-941d-03f2bfd8aa78 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:28.124273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f736468-d4c3-4abc-941d-03f2bfd8aa78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:28.126396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f736468-d4c3-4abc-941d-03f2bfd8aa78 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:28.167901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9170b0-1f43-470b-a66e-36a88325f2f3 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:28.169978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 848/1709] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:27 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:28.199113 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9170b0-1f43-470b-a66e-36a88325f2f3 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:28.213764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64493ad-0b6f-4a0d-93af-09175276be3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:28.218869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64493ad-0b6f-4a0d-93af-09175276be3e admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:28.221969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64493ad-0b6f-4a0d-93af-09175276be3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:28.224826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64493ad-0b6f-4a0d-93af-09175276be3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:28.230930 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64493ad-0b6f-4a0d-93af-09175276be3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:28.241889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64493ad-0b6f-4a0d-93af-09175276be3e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:28.280634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f736468-d4c3-4abc-941d-03f2bfd8aa78 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:28.290188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 862/1710] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:28.317366 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f736468-d4c3-4abc-941d-03f2bfd8aa78 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:28.336207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e434dd7-1d8d-4139-903e-6b5820f1980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:28.338939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e434dd7-1d8d-4139-903e-6b5820f1980b admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:28.339149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e434dd7-1d8d-4139-903e-6b5820f1980b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:28.340387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e434dd7-1d8d-4139-903e-6b5820f1980b admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:28.343174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e434dd7-1d8d-4139-903e-6b5820f1980b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:28.351279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e434dd7-1d8d-4139-903e-6b5820f1980b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:28.401990 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 849/1711] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:07:28.405169 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64493ad-0b6f-4a0d-93af-09175276be3e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:28.418025 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64493ad-0b6f-4a0d-93af-09175276be3e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:28.438755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc4b1a-7ac7-4b15-a0d2-7f6f249c7dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:28.439812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc4b1a-7ac7-4b15-a0d2-7f6f249c7dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:28.440350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc4b1a-7ac7-4b15-a0d2-7f6f249c7dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:28.440862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc4b1a-7ac7-4b15-a0d2-7f6f249c7dc0 admin admin] PATH_INFO: `/v3/projects/c9d02b13e7a44f1da39bf7d429e536d3/users/0ca8a73cff21445d9d77f32f836e76eb/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:28.479557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc4b1a-7ac7-4b15-a0d2-7f6f249c7dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d02b13e7a44f1da39bf7d429e536d3, user_id=0ca8a73cff21445d9d77f32f836e76eb, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:28.483240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc4b1a-7ac7-4b15-a0d2-7f6f249c7dc0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:28.510250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 863/1712] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:28 2022] PUT /identity/v3/projects/c9d02b13e7a44f1da39bf7d429e536d3/users/0ca8a73cff21445d9d77f32f836e76eb/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:28.522309 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3ca2f-d91f-40d8-b5db-d862674ddcb5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:28.522819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3ca2f-d91f-40d8-b5db-d862674ddcb5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:28.523059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3ca2f-d91f-40d8-b5db-d862674ddcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:28.597137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-23e3ca2f-d91f-40d8-b5db-d862674ddcb5 None None] MFA Rules not processed for user `0ca8a73cff21445d9d77f32f836e76eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:28.598659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-23e3ca2f-d91f-40d8-b5db-d862674ddcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:28.751163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:28.802161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 850/1713] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:28.806023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc4b1a-7ac7-4b15-a0d2-7f6f249c7dc0 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:28.980658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc4b1a-7ac7-4b15-a0d2-7f6f249c7dc0 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:28.996403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae085cb-9404-4861-b741-def5104efbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:28.997257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae085cb-9404-4861-b741-def5104efbfd admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:28.997611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae085cb-9404-4861-b741-def5104efbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:28.997985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae085cb-9404-4861-b741-def5104efbfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:29.006036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae085cb-9404-4861-b741-def5104efbfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:29.014844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae085cb-9404-4861-b741-def5104efbfd admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:29.071881 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 864/1714] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:28 2022] POST /identity/v3/projects => generated 377 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:29.075764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3ca2f-d91f-40d8-b5db-d862674ddcb5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:29.108108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3ca2f-d91f-40d8-b5db-d862674ddcb5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:29.275724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e15d-f456-4f04-aa0d-8bba6c00794f None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:29.276226 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e15d-f456-4f04-aa0d-8bba6c00794f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:29.276493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096e15d-f456-4f04-aa0d-8bba6c00794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:29.279143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2c61a-2725-455b-8318-9fdb990857d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:29.279836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2c61a-2725-455b-8318-9fdb990857d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:29.280127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2c61a-2725-455b-8318-9fdb990857d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:29.280436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2c61a-2725-455b-8318-9fdb990857d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:29.281132 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2c61a-2725-455b-8318-9fdb990857d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:29.283162 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2c61a-2725-455b-8318-9fdb990857d7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:29.321263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-5096e15d-f456-4f04-aa0d-8bba6c00794f None None] MFA Rules not processed for user `6bad8a4de2c84319a8601e7625c2655e`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:29.321891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 851/1715] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:29 2022] POST /identity/v3/users => generated 295 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:07:29.323348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5096e15d-f456-4f04-aa0d-8bba6c00794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:29.326100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2c61a-2725-455b-8318-9fdb990857d7 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:29.362255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2c61a-2725-455b-8318-9fdb990857d7 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:29.369316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed2b27-90af-4fed-9e8d-249c010f1c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:29.370204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed2b27-90af-4fed-9e8d-249c010f1c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:29.370641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed2b27-90af-4fed-9e8d-249c010f1c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:29.370891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed2b27-90af-4fed-9e8d-249c010f1c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:29.371604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed2b27-90af-4fed-9e8d-249c010f1c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:29.374067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed2b27-90af-4fed-9e8d-249c010f1c58 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:29.391878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 852/1716] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:29.393068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed2b27-90af-4fed-9e8d-249c010f1c58 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:29.410997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed2b27-90af-4fed-9e8d-249c010f1c58 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:29.438308 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9d27e-4067-4fdf-a4d7-7176dfc06be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:29.439988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9d27e-4067-4fdf-a4d7-7176dfc06be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:29.441746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9d27e-4067-4fdf-a4d7-7176dfc06be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:29.442210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9d27e-4067-4fdf-a4d7-7176dfc06be7 admin admin] PATH_INFO: `/v3/projects/0791c5696ad549559421451c9fb74ebd/users/c56747db60cd4466a2823a55c8b5684b/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:29.482981 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9d27e-4067-4fdf-a4d7-7176dfc06be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0791c5696ad549559421451c9fb74ebd, user_id=c56747db60cd4466a2823a55c8b5684b, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:29.493576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9d27e-4067-4fdf-a4d7-7176dfc06be7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:29.521785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 865/1717] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:29.594700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 853/1718] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:29 2022] PUT /identity/v3/projects/0791c5696ad549559421451c9fb74ebd/users/c56747db60cd4466a2823a55c8b5684b/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:29.598795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096e15d-f456-4f04-aa0d-8bba6c00794f None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:29.634287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096e15d-f456-4f04-aa0d-8bba6c00794f None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:29.693060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:29.822139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b2b61-55a0-4b1f-882b-503c9a6b674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:29.823890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b2b61-55a0-4b1f-882b-503c9a6b674b admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:29.824188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b2b61-55a0-4b1f-882b-503c9a6b674b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:29.824500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b2b61-55a0-4b1f-882b-503c9a6b674b admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:29.838487 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9d27e-4067-4fdf-a4d7-7176dfc06be7 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:29.840603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-48e9d27e-4067-4fdf-a4d7-7176dfc06be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:29.842859 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b2b61-55a0-4b1f-882b-503c9a6b674b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:29.846188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b2b61-55a0-4b1f-882b-503c9a6b674b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:29.878452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9d27e-4067-4fdf-a4d7-7176dfc06be7 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:29.885193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 866/1719] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:29.886518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b2b61-55a0-4b1f-882b-503c9a6b674b admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:29.910600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:29.912052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b2b61-55a0-4b1f-882b-503c9a6b674b admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:29.913117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:29.913896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:29.914518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] PATH_INFO: `/v3/projects/f270c5913c4e495e9fbc809239b421db` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:29.918603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f270c5913c4e495e9fbc809239b421db)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:29.923620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458efc8-dc0a-4ddf-a1af-af07e693f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:29.925248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458efc8-dc0a-4ddf-a1af-af07e693f593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:29.925535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458efc8-dc0a-4ddf-a1af-af07e693f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:29.925825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458efc8-dc0a-4ddf-a1af-af07e693f593 admin admin] PATH_INFO: `/v3/projects/0791c5696ad549559421451c9fb74ebd/users/c56747db60cd4466a2823a55c8b5684b/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:29.926163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:29.928589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458efc8-dc0a-4ddf-a1af-af07e693f593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0791c5696ad549559421451c9fb74ebd, user_id=c56747db60cd4466a2823a55c8b5684b, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:29.938429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458efc8-dc0a-4ddf-a1af-af07e693f593 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:29.955658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 867/1720] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:29 2022] PUT /identity/v3/projects/0791c5696ad549559421451c9fb74ebd/users/c56747db60cd4466a2823a55c8b5684b/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:07:29.969831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db4654-6261-4b4f-97f0-0e9250b94525 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:29.970112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db4654-6261-4b4f-97f0-0e9250b94525 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:29.970305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db4654-6261-4b4f-97f0-0e9250b94525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:30.033461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-05db4654-6261-4b4f-97f0-0e9250b94525 None None] MFA Rules not processed for user `c56747db60cd4466a2823a55c8b5684b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:30.035273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-05db4654-6261-4b4f-97f0-0e9250b94525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:30.063802 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f270c5913c4e495e9fbc809239b421db', 'request_id': 'req-b276d883-43a9-40e9-b172-f6db62ae8f25'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:30.077394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f270c5913c4e495e9fbc809239b421db', 'request_id': 'req-b276d883-43a9-40e9-b172-f6db62ae8f25'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:30.096796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f270c5913c4e495e9fbc809239b421db', 'request_id': 'req-b276d883-43a9-40e9-b172-f6db62ae8f25'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:30.131728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] The token cache is being invalidate because project f270c5913c4e495e9fbc809239b421db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:30.134499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:30.135537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b276d883-43a9-40e9-b172-f6db62ae8f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:30.144906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 854/1721] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:29 2022] DELETE /identity/v3/projects/f270c5913c4e495e9fbc809239b421db => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:30.165129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a141b-8e50-4142-9ab7-465ec88af530 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:30.165429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a141b-8e50-4142-9ab7-465ec88af530 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:30.165720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a141b-8e50-4142-9ab7-465ec88af530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:30.213779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-540a141b-8e50-4142-9ab7-465ec88af530 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:30.215574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-540a141b-8e50-4142-9ab7-465ec88af530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:30.262732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:30.321706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 868/1722] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:30.326491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd4be-50a4-4d23-805b-957ce7348ba8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:30.326942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd4be-50a4-4d23-805b-957ce7348ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:30.328048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fd4be-50a4-4d23-805b-957ce7348ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:30.396153 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 855/1723] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:30.396153 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a141b-8e50-4142-9ab7-465ec88af530 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:30.398954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-540a141b-8e50-4142-9ab7-465ec88af530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:30.469150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8d7fd4be-50a4-4d23-805b-957ce7348ba8 None None] MFA Rules not processed for user `57b64cdf97214cddb23851747cb051d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:30.476501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8d7fd4be-50a4-4d23-805b-957ce7348ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:30.536768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a141b-8e50-4142-9ab7-465ec88af530 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:30.552043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dcf72-58f5-4482-95d9-8181da62d961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:30.553036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dcf72-58f5-4482-95d9-8181da62d961 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:30.554078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dcf72-58f5-4482-95d9-8181da62d961 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:30.555043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dcf72-58f5-4482-95d9-8181da62d961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:30.579664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dcf72-58f5-4482-95d9-8181da62d961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:30.583419 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dcf72-58f5-4482-95d9-8181da62d961 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:30.604723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 869/1724] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:30.607058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952888e5-ec74-46d1-b592-ddf737767ea6 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:30.607477 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952888e5-ec74-46d1-b592-ddf737767ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:30.608217 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952888e5-ec74-46d1-b592-ddf737767ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:30.615723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 856/1725] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:30.618911 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9512cd6-ecad-4c24-98e5-0bc42d84eee2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:30.619677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9512cd6-ecad-4c24-98e5-0bc42d84eee2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:30.620877 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9512cd6-ecad-4c24-98e5-0bc42d84eee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:30.671091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d9512cd6-ecad-4c24-98e5-0bc42d84eee2 None None] MFA Rules not processed for user `57b64cdf97214cddb23851747cb051d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:30.673505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-952888e5-ec74-46d1-b592-ddf737767ea6 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:30.675822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d9512cd6-ecad-4c24-98e5-0bc42d84eee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:30.695606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-952888e5-ec74-46d1-b592-ddf737767ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:30.723136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 857/1726] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:30.733896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57491287-a135-4bd0-aafd-05c4162f1b32 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:30.734188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57491287-a135-4bd0-aafd-05c4162f1b32 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:30.734467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57491287-a135-4bd0-aafd-05c4162f1b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:30.743934 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 870/1727] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:30.746708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952888e5-ec74-46d1-b592-ddf737767ea6 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:30.765974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952888e5-ec74-46d1-b592-ddf737767ea6 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:30.771717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83c584-2335-4c15-ba4c-8fa0ae4ba636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:30.772640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83c584-2335-4c15-ba4c-8fa0ae4ba636 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:30.773141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83c584-2335-4c15-ba4c-8fa0ae4ba636 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:30.773562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83c584-2335-4c15-ba4c-8fa0ae4ba636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:30.776873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8e83c584-2335-4c15-ba4c-8fa0ae4ba636 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:30.788386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:30.802084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-57491287-a135-4bd0-aafd-05c4162f1b32 None None] MFA Rules not processed for user `7f9f7b8e1f534e8f86d9cde7c0b4f633`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:30.805367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-57491287-a135-4bd0-aafd-05c4162f1b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:30.933451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83c584-2335-4c15-ba4c-8fa0ae4ba636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:30.938065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83c584-2335-4c15-ba4c-8fa0ae4ba636 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:30.947498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 858/1728] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:30.948487 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57491287-a135-4bd0-aafd-05c4162f1b32 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:30.949998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-57491287-a135-4bd0-aafd-05c4162f1b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:30.957214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 871/1729] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:30.958188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83c584-2335-4c15-ba4c-8fa0ae4ba636 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:30.986356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83c584-2335-4c15-ba4c-8fa0ae4ba636 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:30.991347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2318d5-9e18-4a09-9ff5-89e4f32cd49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:30.992010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2318d5-9e18-4a09-9ff5-89e4f32cd49e admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:30.992628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2318d5-9e18-4a09-9ff5-89e4f32cd49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:30.992952 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2318d5-9e18-4a09-9ff5-89e4f32cd49e admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:30.993844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2318d5-9e18-4a09-9ff5-89e4f32cd49e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:30.994161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2318d5-9e18-4a09-9ff5-89e4f32cd49e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:31.007233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2318d5-9e18-4a09-9ff5-89e4f32cd49e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:31.042522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 872/1730] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:31.042522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2318d5-9e18-4a09-9ff5-89e4f32cd49e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:31.044636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0e2318d5-9e18-4a09-9ff5-89e4f32cd49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:31.078958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2318d5-9e18-4a09-9ff5-89e4f32cd49e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:31.097655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:31.098557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:31.098846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:31.099128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] PATH_INFO: `/v3/projects/7b063503262a412b849f30128cb3a462` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:31.111537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b063503262a412b849f30128cb3a462)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:31.113588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:31.122981 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:31.167759 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57491287-a135-4bd0-aafd-05c4162f1b32 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:31.188485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73c698-c5a3-43bb-994a-4e4992d75a99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:31.189841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73c698-c5a3-43bb-994a-4e4992d75a99 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:31.190167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73c698-c5a3-43bb-994a-4e4992d75a99 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:31.190450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73c698-c5a3-43bb-994a-4e4992d75a99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:31.209336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73c698-c5a3-43bb-994a-4e4992d75a99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:31.214094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73c698-c5a3-43bb-994a-4e4992d75a99 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:31.226523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b063503262a412b849f30128cb3a462', 'request_id': 'req-9f3c4c31-582f-44e9-b3fe-27f806e4db19'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:31.233239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 859/1731] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:31.240638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3effb09-034f-4b0a-acff-043beb06032a None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:31.241233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3effb09-034f-4b0a-acff-043beb06032a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:31.242210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3effb09-034f-4b0a-acff-043beb06032a None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:31.251338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 860/1732] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jun 20 06:07:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:31.252815 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dd09d-9092-47e6-8220-56cfb17bf6eb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:31.253108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dd09d-9092-47e6-8220-56cfb17bf6eb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:31.253387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2dd09d-9092-47e6-8220-56cfb17bf6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:31.265774 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b063503262a412b849f30128cb3a462', 'request_id': 'req-9f3c4c31-582f-44e9-b3fe-27f806e4db19'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:31.295419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b063503262a412b849f30128cb3a462', 'request_id': 'req-9f3c4c31-582f-44e9-b3fe-27f806e4db19'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:31.300425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-bd2dd09d-9092-47e6-8220-56cfb17bf6eb None None] MFA Rules not processed for user `7f9f7b8e1f534e8f86d9cde7c0b4f633`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:31.302035 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bd2dd09d-9092-47e6-8220-56cfb17bf6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:31.322807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] The token cache is being invalidate because project 7b063503262a412b849f30128cb3a462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:31.322807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:31.325926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:31.332988 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 873/1733] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:31 2022] DELETE /identity/v3/projects/7b063503262a412b849f30128cb3a462 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:31.333995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:31.346172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:31.447435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 861/1734] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:31.450174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5bab8-9cfd-405c-a7d8-95a0b4ba6085 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:31.450772 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5bab8-9cfd-405c-a7d8-95a0b4ba6085 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:31.451283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5bab8-9cfd-405c-a7d8-95a0b4ba6085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:31.554853 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c4c31-582f-44e9-b3fe-27f806e4db19 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:31.576250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b29a1f-c929-4aef-b7e8-1e84e9dba438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:31.578172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29a1f-c929-4aef-b7e8-1e84e9dba438 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:31.579023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29a1f-c929-4aef-b7e8-1e84e9dba438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:31.581038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b29a1f-c929-4aef-b7e8-1e84e9dba438 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:31.581999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b29a1f-c929-4aef-b7e8-1e84e9dba438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:31.586880 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b29a1f-c929-4aef-b7e8-1e84e9dba438 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:31.631518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-23c5bab8-9cfd-405c-a7d8-95a0b4ba6085 None None] MFA Rules not processed for user `70b46194590c47c08c8d9d98904a2d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:31.632802 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-23c5bab8-9cfd-405c-a7d8-95a0b4ba6085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:31.651650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:31.681601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 874/1735] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:31 2022] POST /identity/v3/projects => generated 363 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:31.682960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1773fa-677a-42d6-a974-07c3bfc1b21c None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:31.683250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1773fa-677a-42d6-a974-07c3bfc1b21c None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:31.683533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1773fa-677a-42d6-a974-07c3bfc1b21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:31.720331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-2d1773fa-677a-42d6-a974-07c3bfc1b21c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:31.721806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2d1773fa-677a-42d6-a974-07c3bfc1b21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:31.801395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 862/1736] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:07:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:31.802397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5bab8-9cfd-405c-a7d8-95a0b4ba6085 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:31.829573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5bab8-9cfd-405c-a7d8-95a0b4ba6085 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:31.914843 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 875/1737] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:31.920120 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1773fa-677a-42d6-a974-07c3bfc1b21c None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:31.924406 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2d1773fa-677a-42d6-a974-07c3bfc1b21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:32.009786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a73a09-e435-4ad5-ace6-4e8656ebf6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:32.011104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a73a09-e435-4ad5-ace6-4e8656ebf6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.011596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a73a09-e435-4ad5-ace6-4e8656ebf6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.012071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a73a09-e435-4ad5-ace6-4e8656ebf6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.013570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a73a09-e435-4ad5-ace6-4e8656ebf6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:32.017033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a73a09-e435-4ad5-ace6-4e8656ebf6c9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:32.060368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1773fa-677a-42d6-a974-07c3bfc1b21c None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:32.065408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a212255-2fdf-4e19-8afa-a474a2cd7c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:32.066981 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 863/1738] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:31 2022] POST /identity/v3/users => generated 282 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:32.067472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a212255-2fdf-4e19-8afa-a474a2cd7c65 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.068094 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a212255-2fdf-4e19-8afa-a474a2cd7c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.068661 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f040-cf77-4900-82ab-ec391ef089ef None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.068969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f040-cf77-4900-82ab-ec391ef089ef None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.069648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f040-cf77-4900-82ab-ec391ef089ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.070203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a212255-2fdf-4e19-8afa-a474a2cd7c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.102153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a212255-2fdf-4e19-8afa-a474a2cd7c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:32.104124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a212255-2fdf-4e19-8afa-a474a2cd7c65 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:32.121490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-19b9f040-cf77-4900-82ab-ec391ef089ef None None] MFA Rules not processed for user `c2b89a9466d848529893af51e99be1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:32.126605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-19b9f040-cf77-4900-82ab-ec391ef089ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:32.132419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 876/1739] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:32.134316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67547-5e22-47e8-a81b-ecaf596ffe81 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.134610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67547-5e22-47e8-a81b-ecaf596ffe81 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.134891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa67547-5e22-47e8-a81b-ecaf596ffe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.157861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:32.170596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-2aa67547-5e22-47e8-a81b-ecaf596ffe81 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:32.177836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2aa67547-5e22-47e8-a81b-ecaf596ffe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:32.197450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 877/1740] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:32.199192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f62e3-7dd4-4a48-b25f-d9427ac84208 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.199494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f62e3-7dd4-4a48-b25f-d9427ac84208 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.199775 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f62e3-7dd4-4a48-b25f-d9427ac84208 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.205847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 878/1741] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jun 20 06:07:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:32.206935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f62e3-7dd4-4a48-b25f-d9427ac84208 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:32.229628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f62e3-7dd4-4a48-b25f-d9427ac84208 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:32.244367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350acf14-b697-4f2d-ae3b-a92a993ed7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:32.244367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350acf14-b697-4f2d-ae3b-a92a993ed7fd admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.244367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350acf14-b697-4f2d-ae3b-a92a993ed7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.244367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350acf14-b697-4f2d-ae3b-a92a993ed7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.245409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350acf14-b697-4f2d-ae3b-a92a993ed7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:32.250720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350acf14-b697-4f2d-ae3b-a92a993ed7fd admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:32.279576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 879/1742] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:32.279705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 864/1743] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:32.280487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350acf14-b697-4f2d-ae3b-a92a993ed7fd admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:32.287826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbedef-6eaf-49d6-9073-e5da489ea9a3 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.289225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbedef-6eaf-49d6-9073-e5da489ea9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.292062 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbedef-6eaf-49d6-9073-e5da489ea9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.308665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350acf14-b697-4f2d-ae3b-a92a993ed7fd admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:32.319405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03223937-5bab-40f8-afa7-32384dcff805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:32.320117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223937-5bab-40f8-afa7-32384dcff805 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.322085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223937-5bab-40f8-afa7-32384dcff805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.324051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03223937-5bab-40f8-afa7-32384dcff805 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.326121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03223937-5bab-40f8-afa7-32384dcff805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:32.326444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03223937-5bab-40f8-afa7-32384dcff805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:32.355671 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fedbedef-6eaf-49d6-9073-e5da489ea9a3 None None] MFA Rules not processed for user `70b46194590c47c08c8d9d98904a2d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:32.357509 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fedbedef-6eaf-49d6-9073-e5da489ea9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:32.360777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03223937-5bab-40f8-afa7-32384dcff805 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:32.388956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 865/1744] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:32.389835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbedef-6eaf-49d6-9073-e5da489ea9a3 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:32.392361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 880/1745] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:32.396663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03223937-5bab-40f8-afa7-32384dcff805 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:32.418728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbedef-6eaf-49d6-9073-e5da489ea9a3 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:32.422337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03223937-5bab-40f8-afa7-32384dcff805 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:32.431488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c8817-42e8-4e7b-851b-de5225aa3046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:32.433524 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8817-42e8-4e7b-851b-de5225aa3046 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.434685 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8817-42e8-4e7b-851b-de5225aa3046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.435274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8817-42e8-4e7b-851b-de5225aa3046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.435764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74e513-7b38-452e-ba34-1d4bf832958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:32.437015 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74e513-7b38-452e-ba34-1d4bf832958e admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.437734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c8817-42e8-4e7b-851b-de5225aa3046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:32.439016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74e513-7b38-452e-ba34-1d4bf832958e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.440725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74e513-7b38-452e-ba34-1d4bf832958e admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.441824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74e513-7b38-452e-ba34-1d4bf832958e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:32.448538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c8817-42e8-4e7b-851b-de5225aa3046 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:32.451395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74e513-7b38-452e-ba34-1d4bf832958e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:32.473550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 866/1746] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:32.477790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c8817-42e8-4e7b-851b-de5225aa3046 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:32.508747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c8817-42e8-4e7b-851b-de5225aa3046 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:32.517288 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 881/1747] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:32 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:32.518959 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74e513-7b38-452e-ba34-1d4bf832958e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:32.520093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00099c-e668-4d32-8c73-0db5238f2d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:32.522161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00099c-e668-4d32-8c73-0db5238f2d9d service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.522878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00099c-e668-4d32-8c73-0db5238f2d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.525810 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00099c-e668-4d32-8c73-0db5238f2d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.554437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00099c-e668-4d32-8c73-0db5238f2d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:32.556099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00099c-e668-4d32-8c73-0db5238f2d9d service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:32.581103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 867/1748] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:32.595019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00099c-e668-4d32-8c73-0db5238f2d9d service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:32.645750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00099c-e668-4d32-8c73-0db5238f2d9d service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:32.672042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:32.719202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74e513-7b38-452e-ba34-1d4bf832958e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:32.737137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e58f9-57e7-4e01-8076-a41aeeea12a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:32.740102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e58f9-57e7-4e01-8076-a41aeeea12a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.740612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e58f9-57e7-4e01-8076-a41aeeea12a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.742746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e58f9-57e7-4e01-8076-a41aeeea12a8 admin admin] PATH_INFO: `/v3/projects/c0ea3a24ccb142f7a987635bd72918d0/users/8acee00b81214a72b9a2cdb8255081b8/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.820747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e58f9-57e7-4e01-8076-a41aeeea12a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ea3a24ccb142f7a987635bd72918d0, user_id=8acee00b81214a72b9a2cdb8255081b8, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:32.831753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e58f9-57e7-4e01-8076-a41aeeea12a8 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:32.861606 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851cc9f-4a93-4416-946e-8e6906327fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:32.866639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851cc9f-4a93-4416-946e-8e6906327fec admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.869331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851cc9f-4a93-4416-946e-8e6906327fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.869608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851cc9f-4a93-4416-946e-8e6906327fec admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:32.872666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851cc9f-4a93-4416-946e-8e6906327fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:32.874659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851cc9f-4a93-4416-946e-8e6906327fec admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:32.881246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 882/1749] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:32 2022] PUT /identity/v3/projects/c0ea3a24ccb142f7a987635bd72918d0/users/8acee00b81214a72b9a2cdb8255081b8/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:32.881911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e58f9-57e7-4e01-8076-a41aeeea12a8 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:32.901651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8e6e58f9-57e7-4e01-8076-a41aeeea12a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:32.963804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 868/1750] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:32 2022] POST /identity/v3/users => generated 303 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:32.966335 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061cf86-6b5c-4ef7-9188-63ad6918673a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:32.966875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061cf86-6b5c-4ef7-9188-63ad6918673a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:32.970975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061cf86-6b5c-4ef7-9188-63ad6918673a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:33.059292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a061cf86-6b5c-4ef7-9188-63ad6918673a None None] MFA Rules not processed for user `8acee00b81214a72b9a2cdb8255081b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:33.063985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a061cf86-6b5c-4ef7-9188-63ad6918673a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:33.167536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e58f9-57e7-4e01-8076-a41aeeea12a8 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:33.187307 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954dc9f3-2129-46c6-adc9-fb8d2391f8d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:33.188105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dc9f3-2129-46c6-adc9-fb8d2391f8d4 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:33.188524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dc9f3-2129-46c6-adc9-fb8d2391f8d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:33.188856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954dc9f3-2129-46c6-adc9-fb8d2391f8d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:33.191624 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-954dc9f3-2129-46c6-adc9-fb8d2391f8d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:33.226553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 869/1751] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:33.226553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47198f9-6e40-44b7-9d53-60ea6c615cf1 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:33.226553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47198f9-6e40-44b7-9d53-60ea6c615cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:33.238595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47198f9-6e40-44b7-9d53-60ea6c615cf1 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:33.244583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 870/1752] 10.222.0.13 () {54 vars in 960 bytes} [Mon Jun 20 06:07:33 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:33.245557 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47198f9-6e40-44b7-9d53-60ea6c615cf1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:33.262461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:33.326734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954dc9f3-2129-46c6-adc9-fb8d2391f8d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:33.334715 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954dc9f3-2129-46c6-adc9-fb8d2391f8d4 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:33.377404 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 883/1753] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:33.379248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954dc9f3-2129-46c6-adc9-fb8d2391f8d4 service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:33.484682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47198f9-6e40-44b7-9d53-60ea6c615cf1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:33.523034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2598c-69cc-4fc1-a2bc-63745564f179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:33.523738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2598c-69cc-4fc1-a2bc-63745564f179 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:33.524028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2598c-69cc-4fc1-a2bc-63745564f179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:33.524307 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2598c-69cc-4fc1-a2bc-63745564f179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:33.525086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2598c-69cc-4fc1-a2bc-63745564f179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:33.526716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2598c-69cc-4fc1-a2bc-63745564f179 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:33.601004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 871/1754] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:33.611860 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1515f08-5be1-4185-8066-c4426534772f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:33.612354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1515f08-5be1-4185-8066-c4426534772f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:33.612796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1515f08-5be1-4185-8066-c4426534772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:33.657800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954dc9f3-2129-46c6-adc9-fb8d2391f8d4 service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:33.663998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c1515f08-5be1-4185-8066-c4426534772f None None] MFA Rules not processed for user `0a5e0b53aafc4bf3a23a7882ed12a89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:33.665476 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c1515f08-5be1-4185-8066-c4426534772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:33.684923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7f896-38c9-4622-8ea2-bbe5f5c59ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:33.685632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f896-38c9-4622-8ea2-bbe5f5c59ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:33.685920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f896-38c9-4622-8ea2-bbe5f5c59ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:33.690449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7f896-38c9-4622-8ea2-bbe5f5c59ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:33.692834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7f896-38c9-4622-8ea2-bbe5f5c59ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:33.700873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7f896-38c9-4622-8ea2-bbe5f5c59ccf admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:33.823551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:33.870313 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 884/1755] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:33 2022] POST /identity/v3/projects => generated 365 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:33.871219 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7f896-38c9-4622-8ea2-bbe5f5c59ccf admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:34.001927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 872/1756] 10.222.0.13 () {58 vars in 1057 bytes} [Mon Jun 20 06:07:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:34.009226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1515f08-5be1-4185-8066-c4426534772f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:34.044076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1515f08-5be1-4185-8066-c4426534772f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:34.151007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7f896-38c9-4622-8ea2-bbe5f5c59ccf admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:34.193544 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8e867-bfef-4fa1-8d2e-9d90657b37d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:34.194321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8e867-bfef-4fa1-8d2e-9d90657b37d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:34.194610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8e867-bfef-4fa1-8d2e-9d90657b37d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:34.198794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8e867-bfef-4fa1-8d2e-9d90657b37d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:34.202552 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8e867-bfef-4fa1-8d2e-9d90657b37d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:34.207201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8e867-bfef-4fa1-8d2e-9d90657b37d1 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:34.217196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675ae44-487b-453b-9368-67f457aa6d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:34.224920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675ae44-487b-453b-9368-67f457aa6d27 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:34.225269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675ae44-487b-453b-9368-67f457aa6d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:34.225555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675ae44-487b-453b-9368-67f457aa6d27 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:34.232528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675ae44-487b-453b-9368-67f457aa6d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:34.235267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675ae44-487b-453b-9368-67f457aa6d27 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:34.279897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 885/1757] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:34.281384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8e867-bfef-4fa1-8d2e-9d90657b37d1 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:34.298704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 873/1758] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:34 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:34.299212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675ae44-487b-453b-9368-67f457aa6d27 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:34.301088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7675ae44-487b-453b-9368-67f457aa6d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:34.360443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:34.465857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8e867-bfef-4fa1-8d2e-9d90657b37d1 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:34.466414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675ae44-487b-453b-9368-67f457aa6d27 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:34.475464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fec296-71bf-4ba7-ab07-31f5bec4b6a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e0b53aafc4bf3a23a7882ed12a89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:34.476401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fec296-71bf-4ba7-ab07-31f5bec4b6a9 service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:34.476955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fec296-71bf-4ba7-ab07-31f5bec4b6a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:34.477582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fec296-71bf-4ba7-ab07-31f5bec4b6a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:34.480215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d2fec296-71bf-4ba7-ab07-31f5bec4b6a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:34.491077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987f2a-26d3-4d66-a9e7-cf44ddfaef1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e0b53aafc4bf3a23a7882ed12a89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:34.492029 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987f2a-26d3-4d66-a9e7-cf44ddfaef1c service placement] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:34.492629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987f2a-26d3-4d66-a9e7-cf44ddfaef1c service placement] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:34.493126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61987f2a-26d3-4d66-a9e7-cf44ddfaef1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:34.505612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61987f2a-26d3-4d66-a9e7-cf44ddfaef1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:34.507048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fec296-71bf-4ba7-ab07-31f5bec4b6a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:34.508224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61987f2a-26d3-4d66-a9e7-cf44ddfaef1c service placement] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:34.508862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fec296-71bf-4ba7-ab07-31f5bec4b6a9 service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:34.529172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 886/1759] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:34.530489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987f2a-26d3-4d66-a9e7-cf44ddfaef1c service placement] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:34.542117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61987f2a-26d3-4d66-a9e7-cf44ddfaef1c service placement] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:34.553041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 874/1760] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:34.556821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f986d-03a5-4b3c-9808-579524983ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:34.558085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f986d-03a5-4b3c-9808-579524983ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:34.558876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f986d-03a5-4b3c-9808-579524983ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:34.565480 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f986d-03a5-4b3c-9808-579524983ba4 admin admin] PATH_INFO: `/v3/projects/507d1be345db43f29b2fc7c49423aac1/users/e90236aa99264ace8afa5e0c5d1a47c6/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:34.573903 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fec296-71bf-4ba7-ab07-31f5bec4b6a9 service placement] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:34.603499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fec296-71bf-4ba7-ab07-31f5bec4b6a9 service placement] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:34.609629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f986d-03a5-4b3c-9808-579524983ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507d1be345db43f29b2fc7c49423aac1, user_id=e90236aa99264ace8afa5e0c5d1a47c6, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:34.612278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272ce50-0204-4997-a509-61c95172cd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:34.613263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f986d-03a5-4b3c-9808-579524983ba4 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:34.614536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272ce50-0204-4997-a509-61c95172cd25 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:34.614825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272ce50-0204-4997-a509-61c95172cd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:34.615102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272ce50-0204-4997-a509-61c95172cd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:34.618251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272ce50-0204-4997-a509-61c95172cd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:34.619874 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272ce50-0204-4997-a509-61c95172cd25 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:34.638888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 875/1761] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:34.646704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272ce50-0204-4997-a509-61c95172cd25 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:34.660927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 887/1762] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:34 2022] PUT /identity/v3/projects/507d1be345db43f29b2fc7c49423aac1/users/e90236aa99264ace8afa5e0c5d1a47c6/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:34.664541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272ce50-0204-4997-a509-61c95172cd25 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:34.670486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4738f71-4ea7-4113-b4ca-2c61223571fa None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:34.670856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4738f71-4ea7-4113-b4ca-2c61223571fa None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:34.671213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4738f71-4ea7-4113-b4ca-2c61223571fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:34.708674 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d4738f71-4ea7-4113-b4ca-2c61223571fa None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:34.710043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d4738f71-4ea7-4113-b4ca-2c61223571fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:34.829153 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7953dd-b6ae-4941-b1b9-6bddfcbdf928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:34.832464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7953dd-b6ae-4941-b1b9-6bddfcbdf928 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:34.833361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7953dd-b6ae-4941-b1b9-6bddfcbdf928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:34.834290 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7953dd-b6ae-4941-b1b9-6bddfcbdf928 admin admin] PATH_INFO: `/v3/projects/b166005904e34a078ee94052a2949a5f/users/d8a113e4874a4d7c946830594932be0f/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:34.870571 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:34.881717 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7953dd-b6ae-4941-b1b9-6bddfcbdf928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b166005904e34a078ee94052a2949a5f, user_id=d8a113e4874a4d7c946830594932be0f, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:34.894880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7953dd-b6ae-4941-b1b9-6bddfcbdf928 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:34.918107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 888/1763] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:34.925136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4738f71-4ea7-4113-b4ca-2c61223571fa None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:34.931295 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d4738f71-4ea7-4113-b4ca-2c61223571fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:34.939493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 876/1764] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:34 2022] PUT /identity/v3/projects/b166005904e34a078ee94052a2949a5f/users/d8a113e4874a4d7c946830594932be0f/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:34.945919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7953dd-b6ae-4941-b1b9-6bddfcbdf928 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:35.110109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4738f71-4ea7-4113-b4ca-2c61223571fa None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:35.132721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7953dd-b6ae-4941-b1b9-6bddfcbdf928 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:35.151021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8513873-bd60-43d1-b410-778d6e0e1b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:35.151922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8513873-bd60-43d1-b410-778d6e0e1b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:35.152279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8513873-bd60-43d1-b410-778d6e0e1b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:35.152677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8513873-bd60-43d1-b410-778d6e0e1b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:35.153581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8513873-bd60-43d1-b410-778d6e0e1b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:35.157227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8513873-bd60-43d1-b410-778d6e0e1b2b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:35.198994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 877/1765] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:35.205524 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8513873-bd60-43d1-b410-778d6e0e1b2b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:35.261254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8513873-bd60-43d1-b410-778d6e0e1b2b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:35.281252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d89ef7-b27c-44aa-8c55-0b0e4d82bae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:35.282083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d89ef7-b27c-44aa-8c55-0b0e4d82bae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:35.282439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d89ef7-b27c-44aa-8c55-0b0e4d82bae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:35.282631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d89ef7-b27c-44aa-8c55-0b0e4d82bae9 admin admin] PATH_INFO: `/v3/projects/b166005904e34a078ee94052a2949a5f/users/d8a113e4874a4d7c946830594932be0f/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:35.285892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d89ef7-b27c-44aa-8c55-0b0e4d82bae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b166005904e34a078ee94052a2949a5f, user_id=d8a113e4874a4d7c946830594932be0f, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:35.287347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e9a2a-a329-45b5-bd97-51e2d6f7aae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:35.288064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9a2a-a329-45b5-bd97-51e2d6f7aae7 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:35.288469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9a2a-a329-45b5-bd97-51e2d6f7aae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:35.288753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9a2a-a329-45b5-bd97-51e2d6f7aae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:35.289239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d89ef7-b27c-44aa-8c55-0b0e4d82bae9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:35.328732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e9a2a-a329-45b5-bd97-51e2d6f7aae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:35.329408 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 878/1766] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:35 2022] PUT /identity/v3/projects/b166005904e34a078ee94052a2949a5f/users/d8a113e4874a4d7c946830594932be0f/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:35.333516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e9a2a-a329-45b5-bd97-51e2d6f7aae7 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:35.344930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb665b65-1cbf-4b43-96cc-5f6531d7ef92 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:35.344930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb665b65-1cbf-4b43-96cc-5f6531d7ef92 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:35.345175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb665b65-1cbf-4b43-96cc-5f6531d7ef92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:35.372550 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 889/1767] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:35.373508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e9a2a-a329-45b5-bd97-51e2d6f7aae7 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:35.378407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-091e9a2a-a329-45b5-bd97-51e2d6f7aae7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:35.416570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e9a2a-a329-45b5-bd97-51e2d6f7aae7 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:35.429257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:35.474746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-bb665b65-1cbf-4b43-96cc-5f6531d7ef92 None None] MFA Rules not processed for user `d8a113e4874a4d7c946830594932be0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:35.476263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bb665b65-1cbf-4b43-96cc-5f6531d7ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:35.723146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 879/1768] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:35.725066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15aebb-afe9-4735-b9e2-8dfdd9a2c8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:35.732233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15aebb-afe9-4735-b9e2-8dfdd9a2c8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:35.732606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15aebb-afe9-4735-b9e2-8dfdd9a2c8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:35.732855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15aebb-afe9-4735-b9e2-8dfdd9a2c8d0 admin admin] PATH_INFO: `/v3/users/d70cb37ab9944b26a4d56d334da95749` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:35.735821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb665b65-1cbf-4b43-96cc-5f6531d7ef92 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:35.737757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bb665b65-1cbf-4b43-96cc-5f6531d7ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:35.745469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15aebb-afe9-4735-b9e2-8dfdd9a2c8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70cb37ab9944b26a4d56d334da95749)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:35.760792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15aebb-afe9-4735-b9e2-8dfdd9a2c8d0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:36.060479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2f15aebb-afe9-4735-b9e2-8dfdd9a2c8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70cb37ab9944b26a4d56d334da95749'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:36.111470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2f15aebb-afe9-4735-b9e2-8dfdd9a2c8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70cb37ab9944b26a4d56d334da95749'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:36.114474 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2f15aebb-afe9-4735-b9e2-8dfdd9a2c8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70cb37ab9944b26a4d56d334da95749'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:36.128420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2f15aebb-afe9-4735-b9e2-8dfdd9a2c8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70cb37ab9944b26a4d56d334da95749'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:36.137223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:36.170443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2f15aebb-afe9-4735-b9e2-8dfdd9a2c8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70cb37ab9944b26a4d56d334da95749'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:36.229039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 890/1769] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:35 2022] DELETE /identity/v3/users/d70cb37ab9944b26a4d56d334da95749 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:36.245846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab0f72-99c5-434a-b49c-d080bc6454ac None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:36.246629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab0f72-99c5-434a-b49c-d080bc6454ac None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:36.259505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab0f72-99c5-434a-b49c-d080bc6454ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:36.303845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb665b65-1cbf-4b43-96cc-5f6531d7ef92 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:36.348942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4dab0f72-99c5-434a-b49c-d080bc6454ac None None] MFA Rules not processed for user `57b64cdf97214cddb23851747cb051d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:36.360108 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4dab0f72-99c5-434a-b49c-d080bc6454ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:36.439232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196ffa7-ce56-4f94-9cb7-9859c0210307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:36.439918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196ffa7-ce56-4f94-9cb7-9859c0210307 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:36.440353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196ffa7-ce56-4f94-9cb7-9859c0210307 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:36.440639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196ffa7-ce56-4f94-9cb7-9859c0210307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:36.457759 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0196ffa7-ce56-4f94-9cb7-9859c0210307 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:36.488928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 891/1770] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:36.488928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7913c4c-5537-4fef-8c82-69aef1b47c6c None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:36.488928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7913c4c-5537-4fef-8c82-69aef1b47c6c None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:36.488928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7913c4c-5537-4fef-8c82-69aef1b47c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:36.508926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a7913c4c-5537-4fef-8c82-69aef1b47c6c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:36.510869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a7913c4c-5537-4fef-8c82-69aef1b47c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:36.716220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196ffa7-ce56-4f94-9cb7-9859c0210307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:36.717748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196ffa7-ce56-4f94-9cb7-9859c0210307 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:36.740443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:36.762877 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 880/1771] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 1027 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:36.790569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 892/1772] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:36.803746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196ffa7-ce56-4f94-9cb7-9859c0210307 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:36.808370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0196ffa7-ce56-4f94-9cb7-9859c0210307 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:36.810009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7913c4c-5537-4fef-8c82-69aef1b47c6c None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:36.811856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a7913c4c-5537-4fef-8c82-69aef1b47c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:36.836301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196ffa7-ce56-4f94-9cb7-9859c0210307 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:36.852284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:36.853529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:36.854028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:36.854719 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] PATH_INFO: `/v3/users/37a8d56e57b9407ca77ac9ee58bc0c1f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:36.856868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a8d56e57b9407ca77ac9ee58bc0c1f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:36.868258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:37.004578 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7913c4c-5537-4fef-8c82-69aef1b47c6c None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:37.021392 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1114f-a8d9-4068-a716-fd3ad8e469e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:37.022174 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1114f-a8d9-4068-a716-fd3ad8e469e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:37.022719 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1114f-a8d9-4068-a716-fd3ad8e469e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:37.022843 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a8d56e57b9407ca77ac9ee58bc0c1f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:37.023060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1114f-a8d9-4068-a716-fd3ad8e469e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:37.025106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a8d56e57b9407ca77ac9ee58bc0c1f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:37.041401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a8d56e57b9407ca77ac9ee58bc0c1f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:37.061469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a8d56e57b9407ca77ac9ee58bc0c1f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:37.061469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a8d56e57b9407ca77ac9ee58bc0c1f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:37.066483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1114f-a8d9-4068-a716-fd3ad8e469e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:37.068888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1114f-a8d9-4068-a716-fd3ad8e469e2 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:37.081908 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 893/1773] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:37.088364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 881/1774] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:36 2022] DELETE /identity/v3/users/37a8d56e57b9407ca77ac9ee58bc0c1f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:37.091741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69485899-c87b-4a8e-9bb6-85df4b9690eb None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:37.092125 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69485899-c87b-4a8e-9bb6-85df4b9690eb None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:37.092661 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69485899-c87b-4a8e-9bb6-85df4b9690eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:37.115120 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-69485899-c87b-4a8e-9bb6-85df4b9690eb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:37.118924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-69485899-c87b-4a8e-9bb6-85df4b9690eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:37.185662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:37.396506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 894/1775] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:37.420417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:37.422472 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:37.688623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df378a-e2cf-4252-b986-6e89463071a7 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:37.692674 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69485899-c87b-4a8e-9bb6-85df4b9690eb None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:37.694038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-69485899-c87b-4a8e-9bb6-85df4b9690eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:37.701016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417b768-398c-4aa9-a4b6-43e48f119c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:37.701701 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b768-398c-4aa9-a4b6-43e48f119c0d service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:37.701988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b768-398c-4aa9-a4b6-43e48f119c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:37.702270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417b768-398c-4aa9-a4b6-43e48f119c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:37.723986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417b768-398c-4aa9-a4b6-43e48f119c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:37.725710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417b768-398c-4aa9-a4b6-43e48f119c0d service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:37.733789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69485899-c87b-4a8e-9bb6-85df4b9690eb None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:37.748435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 882/1776] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:37.751720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:37.755210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:37.755508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:37.756942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] PATH_INFO: `/v3/users/8acee00b81214a72b9a2cdb8255081b8` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:37.764746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8acee00b81214a72b9a2cdb8255081b8)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:37.774092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:37.941501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8acee00b81214a72b9a2cdb8255081b8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:37.975253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8acee00b81214a72b9a2cdb8255081b8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:37.978876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8acee00b81214a72b9a2cdb8255081b8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:37.982240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8acee00b81214a72b9a2cdb8255081b8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:38.017014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8acee00b81214a72b9a2cdb8255081b8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:38.048497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 895/1777] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:37 2022] DELETE /identity/v3/users/8acee00b81214a72b9a2cdb8255081b8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:38.050498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7f8c-f83d-45b6-8258-b97970d83eb6 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:38.051831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7f8c-f83d-45b6-8258-b97970d83eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:38.052461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7f8c-f83d-45b6-8258-b97970d83eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:38.132299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-805d7f8c-f83d-45b6-8258-b97970d83eb6 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:38.134344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:38.136254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:38.152834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-805d7f8c-f83d-45b6-8258-b97970d83eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:38.332341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 883/1778] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:38.344613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d7f8c-f83d-45b6-8258-b97970d83eb6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:38.346970 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-805d7f8c-f83d-45b6-8258-b97970d83eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:38.376789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3daa622-3942-41eb-ae05-b3693299557d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:38.394133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:38.397650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:38.399349 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:38.400202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:38.401061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] PATH_INFO: `/v3/projects/0fd944b5382a42d18cb7f8bdf22b461a` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:38.405264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd944b5382a42d18cb7f8bdf22b461a)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:38.415726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:38.473104 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:38.483999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd944b5382a42d18cb7f8bdf22b461a', 'request_id': 'req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:38.486152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d7f8c-f83d-45b6-8258-b97970d83eb6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:38.494697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd944b5382a42d18cb7f8bdf22b461a', 'request_id': 'req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:38.505073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd944b5382a42d18cb7f8bdf22b461a', 'request_id': 'req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:38.525335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] The token cache is being invalidate because project 0fd944b5382a42d18cb7f8bdf22b461a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:38.525733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:38.526718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-304646a6-f35e-49c3-ac72-2b1ab6eb1c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:38.530882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 896/1779] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:38 2022] DELETE /identity/v3/projects/0fd944b5382a42d18cb7f8bdf22b461a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:38.532632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abafe5-b6c2-4341-8303-68530ab3b6bf None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:38.533221 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abafe5-b6c2-4341-8303-68530ab3b6bf None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:38.533509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abafe5-b6c2-4341-8303-68530ab3b6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:38.615721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866805e8-0648-4f97-899f-63ac668b114d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:38.616489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866805e8-0648-4f97-899f-63ac668b114d service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:38.617021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866805e8-0648-4f97-899f-63ac668b114d service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:38.617253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866805e8-0648-4f97-899f-63ac668b114d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:38.618511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-00abafe5-b6c2-4341-8303-68530ab3b6bf None None] MFA Rules not processed for user `e90236aa99264ace8afa5e0c5d1a47c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:38.621906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-866805e8-0648-4f97-899f-63ac668b114d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:38.624328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-00abafe5-b6c2-4341-8303-68530ab3b6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:38.775023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 897/1780] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:38.776207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abafe5-b6c2-4341-8303-68530ab3b6bf None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:38.779348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-00abafe5-b6c2-4341-8303-68530ab3b6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:38.802947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866805e8-0648-4f97-899f-63ac668b114d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:38.804450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866805e8-0648-4f97-899f-63ac668b114d service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:38.818244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 884/1781] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:38.819083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866805e8-0648-4f97-899f-63ac668b114d service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:38.821227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-866805e8-0648-4f97-899f-63ac668b114d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:38.837485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866805e8-0648-4f97-899f-63ac668b114d service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:38.844414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf549eb-118d-4da7-8e1e-29ba05925b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:38.845097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf549eb-118d-4da7-8e1e-29ba05925b96 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:38.845429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf549eb-118d-4da7-8e1e-29ba05925b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:38.845712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf549eb-118d-4da7-8e1e-29ba05925b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:38.847087 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf549eb-118d-4da7-8e1e-29ba05925b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:38.849595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf549eb-118d-4da7-8e1e-29ba05925b96 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:38.920052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 885/1782] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:38 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:38.923474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf549eb-118d-4da7-8e1e-29ba05925b96 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:39.066616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abafe5-b6c2-4341-8303-68530ab3b6bf None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:39.127320 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf549eb-118d-4da7-8e1e-29ba05925b96 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:39.134998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ccde5-6bed-4dd2-871f-ebe72584b25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:39.136086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ccde5-6bed-4dd2-871f-ebe72584b25f admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:39.136751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ccde5-6bed-4dd2-871f-ebe72584b25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:39.137179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ccde5-6bed-4dd2-871f-ebe72584b25f admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:39.138430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ccde5-6bed-4dd2-871f-ebe72584b25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:39.142956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ccde5-6bed-4dd2-871f-ebe72584b25f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:39.157184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:39.158484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:39.159668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:39.159668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] PATH_INFO: `/v3/users/0ca8a73cff21445d9d77f32f836e76eb` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:39.160635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca8a73cff21445d9d77f32f836e76eb)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:39.162750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:39.170457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:39.174736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:39.203789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 886/1783] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:38 2022] POST /identity/v3/users => generated 308 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:39.204751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ccde5-6bed-4dd2-871f-ebe72584b25f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:39.219929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d11ccde5-6bed-4dd2-871f-ebe72584b25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:39.264629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ccde5-6bed-4dd2-871f-ebe72584b25f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:39.305634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:39.311506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca8a73cff21445d9d77f32f836e76eb'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:39.311819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:39.312124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:39.314452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] PATH_INFO: `/v3/projects/17c4965e102940b194bc60c13ceaa32e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:39.320595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c4965e102940b194bc60c13ceaa32e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:39.322578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:39.332189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca8a73cff21445d9d77f32f836e76eb'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:39.333373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca8a73cff21445d9d77f32f836e76eb'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:39.339634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca8a73cff21445d9d77f32f836e76eb'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:39.392952 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca8a73cff21445d9d77f32f836e76eb'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:39.419078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 898/1784] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:38 2022] DELETE /identity/v3/users/0ca8a73cff21445d9d77f32f836e76eb => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:39.420282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:39.425359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:39.521416 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c4965e102940b194bc60c13ceaa32e', 'request_id': 'req-5f31b909-e3fb-499b-957c-73484f7357e0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:39.544716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c4965e102940b194bc60c13ceaa32e', 'request_id': 'req-5f31b909-e3fb-499b-957c-73484f7357e0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:39.562556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c4965e102940b194bc60c13ceaa32e', 'request_id': 'req-5f31b909-e3fb-499b-957c-73484f7357e0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:39.632932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] The token cache is being invalidate because project 17c4965e102940b194bc60c13ceaa32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:39.633233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:39.638439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:39.645372 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 887/1785] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:39 2022] DELETE /identity/v3/projects/17c4965e102940b194bc60c13ceaa32e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:39.649291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:39.653394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:39.656231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e71d-d3f8-4aee-b670-4df6ac9446d9 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:39.894347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147db8ec-68a3-4044-beec-c6e72f695164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:39.895319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147db8ec-68a3-4044-beec-c6e72f695164 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:39.896699 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147db8ec-68a3-4044-beec-c6e72f695164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:39.899728 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147db8ec-68a3-4044-beec-c6e72f695164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:39.900721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147db8ec-68a3-4044-beec-c6e72f695164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:39.902522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147db8ec-68a3-4044-beec-c6e72f695164 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:39.921606 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31b909-e3fb-499b-957c-73484f7357e0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:39.945099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:39.950969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:39.954900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:39.956947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 899/1786] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:39.957413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] PATH_INFO: `/v3/users/c6e93d9c11144e29ad6ecb85a50f7e62` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:39.958440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147db8ec-68a3-4044-beec-c6e72f695164 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:39.960498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e93d9c11144e29ad6ecb85a50f7e62)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:39.965729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-147db8ec-68a3-4044-beec-c6e72f695164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:39.968481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:40.007797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147db8ec-68a3-4044-beec-c6e72f695164 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:40.027441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4f6be-1e41-4b3d-9c7e-b814f147a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:40.028448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4f6be-1e41-4b3d-9c7e-b814f147a9db admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:40.028737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4f6be-1e41-4b3d-9c7e-b814f147a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:40.029017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4f6be-1e41-4b3d-9c7e-b814f147a9db admin admin] PATH_INFO: `/v3/projects/7a6a3ce2d67f4faa84ec3866657371b9/users/6821eb45aa014866b60fec017acb884b/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:40.096787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4f6be-1e41-4b3d-9c7e-b814f147a9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6a3ce2d67f4faa84ec3866657371b9, user_id=6821eb45aa014866b60fec017acb884b, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:40.118326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4f6be-1e41-4b3d-9c7e-b814f147a9db admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:40.135424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e93d9c11144e29ad6ecb85a50f7e62'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:40.139633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e93d9c11144e29ad6ecb85a50f7e62'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:40.172347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 900/1787] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:39 2022] PUT /identity/v3/projects/7a6a3ce2d67f4faa84ec3866657371b9/users/6821eb45aa014866b60fec017acb884b/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:40.176585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4f6be-1e41-4b3d-9c7e-b814f147a9db admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:40.181171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e93d9c11144e29ad6ecb85a50f7e62'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:40.190391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:40.213522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e93d9c11144e29ad6ecb85a50f7e62'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:40.214459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e93d9c11144e29ad6ecb85a50f7e62'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:40.244042 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:INSERT=5,keystone:SELECT=79,keystone:DELETE=16 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:40.285593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 888/1788] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:39 2022] DELETE /identity/v3/users/c6e93d9c11144e29ad6ecb85a50f7e62 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:40.323616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:40.325679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:40.366968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4f6be-1e41-4b3d-9c7e-b814f147a9db admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:40.517488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cb528-cb78-4b3a-90af-c74292d7057d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:40.531404 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:40.533216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:40.534403 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:40.534847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] PATH_INFO: `/v3/projects/c0ea3a24ccb142f7a987635bd72918d0` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:40.536295 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ef8d5-8776-4343-bbc5-49f419bf5e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:40.537303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ea3a24ccb142f7a987635bd72918d0)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:40.538145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef8d5-8776-4343-bbc5-49f419bf5e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:40.540190 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef8d5-8776-4343-bbc5-49f419bf5e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:40.540634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ef8d5-8776-4343-bbc5-49f419bf5e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:40.541561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef8d5-8776-4343-bbc5-49f419bf5e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:40.543669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ef8d5-8776-4343-bbc5-49f419bf5e66 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:40.544188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:40.574948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 901/1789] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:40.576920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b044-33d9-4879-9835-fe7cb9924f7f None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:40.577377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b044-33d9-4879-9835-fe7cb9924f7f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:40.577820 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b044-33d9-4879-9835-fe7cb9924f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:40.615763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8999b044-33d9-4879-9835-fe7cb9924f7f None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:40.630074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8999b044-33d9-4879-9835-fe7cb9924f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:40.655347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ea3a24ccb142f7a987635bd72918d0', 'request_id': 'req-979a3a74-2b83-4b69-a5d5-598446511652'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:40.674347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ea3a24ccb142f7a987635bd72918d0', 'request_id': 'req-979a3a74-2b83-4b69-a5d5-598446511652'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:40.687027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ea3a24ccb142f7a987635bd72918d0', 'request_id': 'req-979a3a74-2b83-4b69-a5d5-598446511652'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:40.711267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] The token cache is being invalidate because project c0ea3a24ccb142f7a987635bd72918d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:40.713179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:40.715943 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:40.724612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 889/1790] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:40 2022] DELETE /identity/v3/projects/c0ea3a24ccb142f7a987635bd72918d0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:40.725749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:40.729826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:40.773532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 902/1791] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:07:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:40.774441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999b044-33d9-4879-9835-fe7cb9924f7f None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:40.778856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8999b044-33d9-4879-9835-fe7cb9924f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:40.948246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a3a74-2b83-4b69-a5d5-598446511652 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:40.961161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df54b98-6d1b-4fc5-94cd-19e404f0af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:40.966207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df54b98-6d1b-4fc5-94cd-19e404f0af59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:40.967436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df54b98-6d1b-4fc5-94cd-19e404f0af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:40.970870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df54b98-6d1b-4fc5-94cd-19e404f0af59 admin admin] PATH_INFO: `/v3/projects/7a6a3ce2d67f4faa84ec3866657371b9/users/6821eb45aa014866b60fec017acb884b/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:40.976028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df54b98-6d1b-4fc5-94cd-19e404f0af59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6a3ce2d67f4faa84ec3866657371b9, user_id=6821eb45aa014866b60fec017acb884b, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:40.982442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df54b98-6d1b-4fc5-94cd-19e404f0af59 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:40.984386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:41.027887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 890/1792] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:40 2022] PUT /identity/v3/projects/7a6a3ce2d67f4faa84ec3866657371b9/users/6821eb45aa014866b60fec017acb884b/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:41.032987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df54b98-6d1b-4fc5-94cd-19e404f0af59 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:41.038444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5df54b98-6d1b-4fc5-94cd-19e404f0af59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:41.046678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999b044-33d9-4879-9835-fe7cb9924f7f None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:41.119412 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:41.133513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:41.134405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:41.134770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:41.135475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] PATH_INFO: `/v3/users/d8a113e4874a4d7c946830594932be0f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:41.136292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a113e4874a4d7c946830594932be0f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:41.139511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:41.217911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a113e4874a4d7c946830594932be0f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.238289 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df54b98-6d1b-4fc5-94cd-19e404f0af59 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:41.240514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a113e4874a4d7c946830594932be0f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.249159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a113e4874a4d7c946830594932be0f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.251947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a113e4874a4d7c946830594932be0f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.259028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:41.259927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:41.260206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:41.260510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] PATH_INFO: `/v3/projects/c9d02b13e7a44f1da39bf7d429e536d3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:41.270276 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d02b13e7a44f1da39bf7d429e536d3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:41.280454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:41.294511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a113e4874a4d7c946830594932be0f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.325929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 903/1793] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:40 2022] DELETE /identity/v3/users/d8a113e4874a4d7c946830594932be0f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:41.327005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:41.329963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:41.370369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d02b13e7a44f1da39bf7d429e536d3', 'request_id': 'req-090c937d-c454-4180-a441-736eb4c289bb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.378258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d02b13e7a44f1da39bf7d429e536d3', 'request_id': 'req-090c937d-c454-4180-a441-736eb4c289bb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.391014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d02b13e7a44f1da39bf7d429e536d3', 'request_id': 'req-090c937d-c454-4180-a441-736eb4c289bb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.418630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] The token cache is being invalidate because project c9d02b13e7a44f1da39bf7d429e536d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:41.420097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.421978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.426355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 891/1794] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:41 2022] DELETE /identity/v3/projects/c9d02b13e7a44f1da39bf7d429e536d3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:41.431668 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:41.433472 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:41.451859 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a10b2e-5ef2-4308-bfc3-a826a7a578b1 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:41.494383 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:41.617774 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c937d-c454-4180-a441-736eb4c289bb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:41.631973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8c274-9825-4175-aa80-0474c82a432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:41.634143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8c274-9825-4175-aa80-0474c82a432f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:41.636389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8c274-9825-4175-aa80-0474c82a432f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:41.636996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8c274-9825-4175-aa80-0474c82a432f admin admin] PATH_INFO: `/v3/users/c56747db60cd4466a2823a55c8b5684b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:41.643534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8c274-9825-4175-aa80-0474c82a432f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56747db60cd4466a2823a55c8b5684b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:41.649553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8c274-9825-4175-aa80-0474c82a432f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:41.680393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe80bd-61aa-45da-9c9c-26bb81edf7df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:41.681060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe80bd-61aa-45da-9c9c-26bb81edf7df service swift] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:41.681343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe80bd-61aa-45da-9c9c-26bb81edf7df service swift] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:41.681855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe80bd-61aa-45da-9c9c-26bb81edf7df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:41.683743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0ebe80bd-61aa-45da-9c9c-26bb81edf7df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:41.735861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fde8c274-9825-4175-aa80-0474c82a432f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56747db60cd4466a2823a55c8b5684b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.736686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fde8c274-9825-4175-aa80-0474c82a432f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56747db60cd4466a2823a55c8b5684b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.738459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:41.748858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fde8c274-9825-4175-aa80-0474c82a432f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56747db60cd4466a2823a55c8b5684b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.772432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fde8c274-9825-4175-aa80-0474c82a432f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56747db60cd4466a2823a55c8b5684b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.773185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fde8c274-9825-4175-aa80-0474c82a432f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56747db60cd4466a2823a55c8b5684b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:41.796844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe80bd-61aa-45da-9c9c-26bb81edf7df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:41.798460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe80bd-61aa-45da-9c9c-26bb81edf7df service swift] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:41.810407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 904/1795] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:07:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:07:41.845777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 892/1796] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:41 2022] DELETE /identity/v3/users/c56747db60cd4466a2823a55c8b5684b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:07:42.946321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe80bd-61aa-45da-9c9c-26bb81edf7df service swift] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:42.947907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0ebe80bd-61aa-45da-9c9c-26bb81edf7df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:42.973759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe80bd-61aa-45da-9c9c-26bb81edf7df service swift] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:43.160010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:43.163262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:43.163756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:43.165189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] PATH_INFO: `/v3/projects/00da2c378ab54d8eafe30f1a3d0eaad6` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:43.167802 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00da2c378ab54d8eafe30f1a3d0eaad6)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:43.173456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:43.291819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00da2c378ab54d8eafe30f1a3d0eaad6', 'request_id': 'req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:43.302750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00da2c378ab54d8eafe30f1a3d0eaad6', 'request_id': 'req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:43.310874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00da2c378ab54d8eafe30f1a3d0eaad6', 'request_id': 'req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:43.313563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:43.341211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] The token cache is being invalidate because project 00da2c378ab54d8eafe30f1a3d0eaad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:43.341714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:43.342312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f160cd9e-b3c2-4927-b8ae-b6c61ddb1523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:43.347789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 905/1797] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:42 2022] DELETE /identity/v3/projects/00da2c378ab54d8eafe30f1a3d0eaad6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:43.352365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ea003-4d9d-4f1e-a89c-d26d784481f3 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:43.353123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ea003-4d9d-4f1e-a89c-d26d784481f3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:43.353123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ea003-4d9d-4f1e-a89c-d26d784481f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:43.401493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7b4ea003-4d9d-4f1e-a89c-d26d784481f3 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:43.405443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7b4ea003-4d9d-4f1e-a89c-d26d784481f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:43.614556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 893/1798] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:43.622749 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852474-fa5a-43e7-ac26-b4fd187f1166 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:43.623200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852474-fa5a-43e7-ac26-b4fd187f1166 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:43.623789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18852474-fa5a-43e7-ac26-b4fd187f1166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:43.677874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-18852474-fa5a-43e7-ac26-b4fd187f1166 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:43.681315 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-18852474-fa5a-43e7-ac26-b4fd187f1166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:43.716504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 906/1799] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:43.717056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ea003-4d9d-4f1e-a89c-d26d784481f3 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:43.735402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ea003-4d9d-4f1e-a89c-d26d784481f3 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:43.751968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4c5e-b6f0-4879-9085-fc2076c8f7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:43.754225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4c5e-b6f0-4879-9085-fc2076c8f7df admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:43.756375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4c5e-b6f0-4879-9085-fc2076c8f7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:43.756776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4c5e-b6f0-4879-9085-fc2076c8f7df admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:43.757664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd4c5e-b6f0-4879-9085-fc2076c8f7df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:43.758826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd4c5e-b6f0-4879-9085-fc2076c8f7df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:43.763991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd4c5e-b6f0-4879-9085-fc2076c8f7df admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:43.790481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 894/1800] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:07:43.795436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18852474-fa5a-43e7-ac26-b4fd187f1166 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:43.812571 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18852474-fa5a-43e7-ac26-b4fd187f1166 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:43.830576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cda5e-2ab0-42a6-82e2-18382d5d958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:43.833068 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cda5e-2ab0-42a6-82e2-18382d5d958c admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:43.833421 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cda5e-2ab0-42a6-82e2-18382d5d958c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:43.836604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cda5e-2ab0-42a6-82e2-18382d5d958c admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:43.838883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cda5e-2ab0-42a6-82e2-18382d5d958c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:43.845396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cda5e-2ab0-42a6-82e2-18382d5d958c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:43.913450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 907/1801] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:43 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:43.918265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4c5e-b6f0-4879-9085-fc2076c8f7df admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:43.935417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4c5e-b6f0-4879-9085-fc2076c8f7df admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:44.063036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4de1e-0992-4994-b4e5-70170e7a9fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:44.064156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4de1e-0992-4994-b4e5-70170e7a9fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:44.065020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4de1e-0992-4994-b4e5-70170e7a9fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:44.067119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4de1e-0992-4994-b4e5-70170e7a9fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:44.068225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4de1e-0992-4994-b4e5-70170e7a9fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:44.073985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4de1e-0992-4994-b4e5-70170e7a9fb3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:44.120087 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 895/1802] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:43 2022] POST /identity/v3/users => generated 285 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:07:44.124281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cda5e-2ab0-42a6-82e2-18382d5d958c admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:44.141636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cda5e-2ab0-42a6-82e2-18382d5d958c admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:44.159837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e53e1-889f-4e01-a24a-b8fe435ccbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:44.160754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e53e1-889f-4e01-a24a-b8fe435ccbfe admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:44.161152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e53e1-889f-4e01-a24a-b8fe435ccbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:44.161809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e53e1-889f-4e01-a24a-b8fe435ccbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:44.163216 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e53e1-889f-4e01-a24a-b8fe435ccbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:44.164361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e53e1-889f-4e01-a24a-b8fe435ccbfe admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:44.184011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 908/1803] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:07:44.187806 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4de1e-0992-4994-b4e5-70170e7a9fb3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:44.204534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4de1e-0992-4994-b4e5-70170e7a9fb3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:44.211405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07baf43-37e4-4e4f-a05a-58e15b6e6a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:44.212241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07baf43-37e4-4e4f-a05a-58e15b6e6a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:44.213025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07baf43-37e4-4e4f-a05a-58e15b6e6a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:44.213557 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07baf43-37e4-4e4f-a05a-58e15b6e6a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:44.214410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07baf43-37e4-4e4f-a05a-58e15b6e6a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:44.217111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07baf43-37e4-4e4f-a05a-58e15b6e6a94 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:44.229447 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 896/1804] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:07:44.234163 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e53e1-889f-4e01-a24a-b8fe435ccbfe admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:44.253854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e53e1-889f-4e01-a24a-b8fe435ccbfe admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:44.259948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e03c5-b894-4ac7-9773-dc76bcfbb22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:44.261053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e03c5-b894-4ac7-9773-dc76bcfbb22c admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:44.261598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e03c5-b894-4ac7-9773-dc76bcfbb22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:44.262738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e03c5-b894-4ac7-9773-dc76bcfbb22c admin admin] PATH_INFO: `/v3/projects/bf13abf426a2475d977fa948bb746f71/users/f3a023e3f7f0478d999869a4cac1514c/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:44.294569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e03c5-b894-4ac7-9773-dc76bcfbb22c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf13abf426a2475d977fa948bb746f71, user_id=f3a023e3f7f0478d999869a4cac1514c, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:44.297607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e03c5-b894-4ac7-9773-dc76bcfbb22c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:44.338637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 909/1805] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:44 2022] PUT /identity/v3/projects/bf13abf426a2475d977fa948bb746f71/users/f3a023e3f7f0478d999869a4cac1514c/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:44.340866 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29ed2c-bf87-4ae5-bf70-ff2be1f3af2e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:44.341236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29ed2c-bf87-4ae5-bf70-ff2be1f3af2e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:44.341586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29ed2c-bf87-4ae5-bf70-ff2be1f3af2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:44.399588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ab29ed2c-bf87-4ae5-bf70-ff2be1f3af2e None None] MFA Rules not processed for user `f3a023e3f7f0478d999869a4cac1514c`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:44.405007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ab29ed2c-bf87-4ae5-bf70-ff2be1f3af2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:44.467263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:44.588903 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 897/1806] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:44.592592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e03c5-b894-4ac7-9773-dc76bcfbb22c admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:44.640966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29ed2c-bf87-4ae5-bf70-ff2be1f3af2e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:44.642682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ab29ed2c-bf87-4ae5-bf70-ff2be1f3af2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:44.801093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29ed2c-bf87-4ae5-bf70-ff2be1f3af2e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:44.816973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:44.817868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:44.818152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:44.818504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] PATH_INFO: `/v3/projects/b166005904e34a078ee94052a2949a5f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:44.819810 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b166005904e34a078ee94052a2949a5f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:44.829393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:44.947020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b166005904e34a078ee94052a2949a5f', 'request_id': 'req-c554beb0-a487-4823-a210-fa5bcb98802e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:44.958972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b166005904e34a078ee94052a2949a5f', 'request_id': 'req-c554beb0-a487-4823-a210-fa5bcb98802e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:44.972065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b166005904e34a078ee94052a2949a5f', 'request_id': 'req-c554beb0-a487-4823-a210-fa5bcb98802e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:44.994778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] The token cache is being invalidate because project b166005904e34a078ee94052a2949a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:44.995153 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:44.997216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c554beb0-a487-4823-a210-fa5bcb98802e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:45.000859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 898/1807] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:44 2022] DELETE /identity/v3/projects/b166005904e34a078ee94052a2949a5f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:45.003605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2a50e-a260-4dbc-8fa7-9582ecabe3ba None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:45.003888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2a50e-a260-4dbc-8fa7-9582ecabe3ba None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:45.004304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2a50e-a260-4dbc-8fa7-9582ecabe3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:45.054020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e03c5-b894-4ac7-9773-dc76bcfbb22c admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:45.060430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d2e2a50e-a260-4dbc-8fa7-9582ecabe3ba None None] MFA Rules not processed for user `6821eb45aa014866b60fec017acb884b`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:45.061678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d2e2a50e-a260-4dbc-8fa7-9582ecabe3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:45.144631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:45.203707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6de03b-c8ae-4356-8218-18e136f7fc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:45.204358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6de03b-c8ae-4356-8218-18e136f7fc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:45.206450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6de03b-c8ae-4356-8218-18e136f7fc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:45.206703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6de03b-c8ae-4356-8218-18e136f7fc61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:45.207426 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6de03b-c8ae-4356-8218-18e136f7fc61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:45.209385 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6de03b-c8ae-4356-8218-18e136f7fc61 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:45.217229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 899/1808] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:45.218620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8dafa-ce35-489e-b2af-6b0fe9d7abbd None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:45.218854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8dafa-ce35-489e-b2af-6b0fe9d7abbd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:45.219539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8dafa-ce35-489e-b2af-6b0fe9d7abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:45.289615 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-64f8dafa-ce35-489e-b2af-6b0fe9d7abbd None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:45.298429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-64f8dafa-ce35-489e-b2af-6b0fe9d7abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:45.300699 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 910/1809] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:44 2022] POST /identity/v3/projects => generated 369 bytes in 709 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:07:45.305381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6de03b-c8ae-4356-8218-18e136f7fc61 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:45.310453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4c6de03b-c8ae-4356-8218-18e136f7fc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:45.357659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:45.498663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 900/1810] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:45.507694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8c4fc-3386-4b2f-ad2b-007ddb70385b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:45.508612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8c4fc-3386-4b2f-ad2b-007ddb70385b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:45.509054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8c4fc-3386-4b2f-ad2b-007ddb70385b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:45.522516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6de03b-c8ae-4356-8218-18e136f7fc61 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:45.545327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e94911-15ee-45ca-b3a4-67f79271f6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:45.546033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94911-15ee-45ca-b3a4-67f79271f6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:45.546316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94911-15ee-45ca-b3a4-67f79271f6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:45.546588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94911-15ee-45ca-b3a4-67f79271f6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:45.547293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e94911-15ee-45ca-b3a4-67f79271f6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:45.551953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e94911-15ee-45ca-b3a4-67f79271f6b0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:45.558634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-67f8c4fc-3386-4b2f-ad2b-007ddb70385b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:45.564990 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-67f8c4fc-3386-4b2f-ad2b-007ddb70385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:45.595405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 901/1811] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:45.600209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8c4fc-3386-4b2f-ad2b-007ddb70385b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:45.619559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 911/1812] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:45 2022] POST /identity/v3/users => generated 291 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:45.621585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e94911-15ee-45ca-b3a4-67f79271f6b0 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:45.624491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8c4fc-3386-4b2f-ad2b-007ddb70385b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:45.630073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d92b7e-89bc-425f-b037-6abe619282c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:45.631510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d92b7e-89bc-425f-b037-6abe619282c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:45.632220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d92b7e-89bc-425f-b037-6abe619282c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:45.632742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d92b7e-89bc-425f-b037-6abe619282c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:45.633733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d92b7e-89bc-425f-b037-6abe619282c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:45.634378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d92b7e-89bc-425f-b037-6abe619282c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:45.638650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d92b7e-89bc-425f-b037-6abe619282c3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:45.640193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e94911-15ee-45ca-b3a4-67f79271f6b0 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:45.660727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc95944-9701-451c-8f2a-3d9950edbe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:45.661803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc95944-9701-451c-8f2a-3d9950edbe8d admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:45.662338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc95944-9701-451c-8f2a-3d9950edbe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:45.663052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc95944-9701-451c-8f2a-3d9950edbe8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:45.665116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc95944-9701-451c-8f2a-3d9950edbe8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:45.669566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc95944-9701-451c-8f2a-3d9950edbe8d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:45.689768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 902/1813] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:45.696591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d92b7e-89bc-425f-b037-6abe619282c3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:45.716907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 912/1814] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:45.719793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc95944-9701-451c-8f2a-3d9950edbe8d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:45.745135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d92b7e-89bc-425f-b037-6abe619282c3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:45.761519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e398a-b2c1-4123-a5cc-c831dde2f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:45.763026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e398a-b2c1-4123-a5cc-c831dde2f491 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:45.763451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e398a-b2c1-4123-a5cc-c831dde2f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:45.763798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e398a-b2c1-4123-a5cc-c831dde2f491 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:45.764615 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e398a-b2c1-4123-a5cc-c831dde2f491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:45.766829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e398a-b2c1-4123-a5cc-c831dde2f491 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:45.767180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc95944-9701-451c-8f2a-3d9950edbe8d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:45.798354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa9ca1-b973-48dc-ac05-68cdbbf006ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:45.802965 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa9ca1-b973-48dc-ac05-68cdbbf006ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:45.804655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa9ca1-b973-48dc-ac05-68cdbbf006ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:45.806152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa9ca1-b973-48dc-ac05-68cdbbf006ca admin admin] PATH_INFO: `/v3/projects/b813110b57bf40bc991bf13988bbad01/users/d3a9f2a223fc47e0a73633ea57239b07/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:45.833875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 903/1815] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:45 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:45.837954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e398a-b2c1-4123-a5cc-c831dde2f491 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:45.864633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa9ca1-b973-48dc-ac05-68cdbbf006ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b813110b57bf40bc991bf13988bbad01, user_id=d3a9f2a223fc47e0a73633ea57239b07, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:45.868725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa9ca1-b973-48dc-ac05-68cdbbf006ca admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:45.938166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 913/1816] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:45 2022] PUT /identity/v3/projects/b813110b57bf40bc991bf13988bbad01/users/d3a9f2a223fc47e0a73633ea57239b07/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:45.940231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d441e9-5152-4741-a603-101c6866db69 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:45.943309 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d441e9-5152-4741-a603-101c6866db69 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:45.943309 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d441e9-5152-4741-a603-101c6866db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:45.971677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-06d441e9-5152-4741-a603-101c6866db69 None None] MFA Rules not processed for user `70b46194590c47c08c8d9d98904a2d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:45.974083 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-06d441e9-5152-4741-a603-101c6866db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:46.094590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 914/1817] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jun 20 06:07:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:46.096723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d441e9-5152-4741-a603-101c6866db69 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:46.136669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e398a-b2c1-4123-a5cc-c831dde2f491 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:46.265540 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:46.312572 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa8d64-489d-4dd3-87fe-51f9cd402634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:46.315759 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8d64-489d-4dd3-87fe-51f9cd402634 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:46.316491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8d64-489d-4dd3-87fe-51f9cd402634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:46.317045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa8d64-489d-4dd3-87fe-51f9cd402634 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:46.317995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa8d64-489d-4dd3-87fe-51f9cd402634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:46.323228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa8d64-489d-4dd3-87fe-51f9cd402634 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:46.373112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 904/1818] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:45 2022] POST /identity/v3/users => generated 283 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:07:46.375665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa8d64-489d-4dd3-87fe-51f9cd402634 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:46.382811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-effa8d64-489d-4dd3-87fe-51f9cd402634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:46.411505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa8d64-489d-4dd3-87fe-51f9cd402634 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:46.436029 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d441e9-5152-4741-a603-101c6866db69 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:46.444494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa071a2-8d35-4869-805d-92bc1a76c49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:46.445382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa071a2-8d35-4869-805d-92bc1a76c49f admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:46.445753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa071a2-8d35-4869-805d-92bc1a76c49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:46.446249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa071a2-8d35-4869-805d-92bc1a76c49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:46.447098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa071a2-8d35-4869-805d-92bc1a76c49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:46.447605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d542-1d63-430e-b4e7-6cf0f17131f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:46.448585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d542-1d63-430e-b4e7-6cf0f17131f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:46.450852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d542-1d63-430e-b4e7-6cf0f17131f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:46.451375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d542-1d63-430e-b4e7-6cf0f17131f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:46.452650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa071a2-8d35-4869-805d-92bc1a76c49f admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:46.470522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d542-1d63-430e-b4e7-6cf0f17131f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:46.481650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 915/1819] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:46.482599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d542-1d63-430e-b4e7-6cf0f17131f3 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:46.482978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa071a2-8d35-4869-805d-92bc1a76c49f admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:46.495006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 905/1820] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:46.496883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d542-1d63-430e-b4e7-6cf0f17131f3 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:46.502490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa071a2-8d35-4869-805d-92bc1a76c49f admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:46.519643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3b314-376f-49a7-b2b1-32c715d166fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:46.520416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3b314-376f-49a7-b2b1-32c715d166fe admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:46.520713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3b314-376f-49a7-b2b1-32c715d166fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:46.521259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3b314-376f-49a7-b2b1-32c715d166fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:46.522173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3b314-376f-49a7-b2b1-32c715d166fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:46.523969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3b314-376f-49a7-b2b1-32c715d166fe admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:46.535123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d542-1d63-430e-b4e7-6cf0f17131f3 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:46.541942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 916/1821] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:46.547314 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3b314-376f-49a7-b2b1-32c715d166fe admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:46.549385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f2a1-2701-42f9-9539-bcbb65eecc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:46.550414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f2a1-2701-42f9-9539-bcbb65eecc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:46.550698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f2a1-2701-42f9-9539-bcbb65eecc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:46.550979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f2a1-2701-42f9-9539-bcbb65eecc0d admin admin] PATH_INFO: `/v3/projects/b813110b57bf40bc991bf13988bbad01/users/d3a9f2a223fc47e0a73633ea57239b07/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:46.557650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f2a1-2701-42f9-9539-bcbb65eecc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b813110b57bf40bc991bf13988bbad01, user_id=d3a9f2a223fc47e0a73633ea57239b07, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:46.561385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f2a1-2701-42f9-9539-bcbb65eecc0d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:46.564658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3b314-376f-49a7-b2b1-32c715d166fe admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:46.572432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cc436-bb8d-4bac-ab44-7a8df023db04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:46.574563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc436-bb8d-4bac-ab44-7a8df023db04 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:46.575399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc436-bb8d-4bac-ab44-7a8df023db04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:46.576158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cc436-bb8d-4bac-ab44-7a8df023db04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:46.579271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cc436-bb8d-4bac-ab44-7a8df023db04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:46.581817 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cc436-bb8d-4bac-ab44-7a8df023db04 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:46.585607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:46.603295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 906/1822] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:46 2022] PUT /identity/v3/projects/b813110b57bf40bc991bf13988bbad01/users/d3a9f2a223fc47e0a73633ea57239b07/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:46.603295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f2a1-2701-42f9-9539-bcbb65eecc0d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:46.610323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7683f2a1-2701-42f9-9539-bcbb65eecc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:46.642391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 917/1823] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:07:46.678258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e266e80-80fd-4623-9c18-ae248c3b7d64 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:46.680914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e266e80-80fd-4623-9c18-ae248c3b7d64 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:46.684352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e266e80-80fd-4623-9c18-ae248c3b7d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:46.779461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-7e266e80-80fd-4623-9c18-ae248c3b7d64 None None] MFA Rules not processed for user `d3a9f2a223fc47e0a73633ea57239b07`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:46.783429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f2a1-2701-42f9-9539-bcbb65eecc0d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:46.784661 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7e266e80-80fd-4623-9c18-ae248c3b7d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:46.800883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:46.801814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:46.802588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:46.802889 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] PATH_INFO: `/v3/projects/0791c5696ad549559421451c9fb74ebd` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:46.804228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=0791c5696ad549559421451c9fb74ebd)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:46.806790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:46.934780 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0791c5696ad549559421451c9fb74ebd', 'request_id': 'req-af0147cc-f7fe-4718-8325-523943c6d0ab'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:46.949301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0791c5696ad549559421451c9fb74ebd', 'request_id': 'req-af0147cc-f7fe-4718-8325-523943c6d0ab'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:46.963646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0791c5696ad549559421451c9fb74ebd', 'request_id': 'req-af0147cc-f7fe-4718-8325-523943c6d0ab'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:46.980013 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 918/1824] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:46.981798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e266e80-80fd-4623-9c18-ae248c3b7d64 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:47.002446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e266e80-80fd-4623-9c18-ae248c3b7d64 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:47.016084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] The token cache is being invalidate because project 0791c5696ad549559421451c9fb74ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:47.017030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:47.022672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:47.025691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 907/1825] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:46 2022] DELETE /identity/v3/projects/0791c5696ad549559421451c9fb74ebd => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:47.033169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:47.036468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:47.135574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:47.201370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0147cc-f7fe-4718-8325-523943c6d0ab admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:47.208247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee1131-4bd3-4fba-805b-5899d2abbc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:47.208247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee1131-4bd3-4fba-805b-5899d2abbc3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.208247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee1131-4bd3-4fba-805b-5899d2abbc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.208247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee1131-4bd3-4fba-805b-5899d2abbc3e admin admin] PATH_INFO: `/v3/projects/f32e5760b29743809f9a70eedebe2ded/users/40417167d8f246de8d45552253a02cc1/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.213829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1f88e-a3c3-4384-84fa-fa109c9252f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:47.216242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1f88e-a3c3-4384-84fa-fa109c9252f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.216589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1f88e-a3c3-4384-84fa-fa109c9252f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.216875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1f88e-a3c3-4384-84fa-fa109c9252f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.224837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-77d1f88e-a3c3-4384-84fa-fa109c9252f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:47.272826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee1131-4bd3-4fba-805b-5899d2abbc3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32e5760b29743809f9a70eedebe2ded, user_id=40417167d8f246de8d45552253a02cc1, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:47.275690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee1131-4bd3-4fba-805b-5899d2abbc3e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:47.329027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 919/1826] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:46 2022] PUT /identity/v3/projects/f32e5760b29743809f9a70eedebe2ded/users/40417167d8f246de8d45552253a02cc1/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:47.331404 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37107ca-3370-40ea-ab1c-b037782bd12d None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.332209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37107ca-3370-40ea-ab1c-b037782bd12d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.332649 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37107ca-3370-40ea-ab1c-b037782bd12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.383925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-f37107ca-3370-40ea-ab1c-b037782bd12d None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:47.386165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f37107ca-3370-40ea-ab1c-b037782bd12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:47.408603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1f88e-a3c3-4384-84fa-fa109c9252f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:47.410489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1f88e-a3c3-4384-84fa-fa109c9252f3 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:47.432014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 908/1827] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:47 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:47.433571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32096dd-7036-412c-b0cf-5e691e217db3 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.448468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32096dd-7036-412c-b0cf-5e691e217db3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.448930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32096dd-7036-412c-b0cf-5e691e217db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.553486 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f32096dd-7036-412c-b0cf-5e691e217db3 None None] MFA Rules not processed for user `40417167d8f246de8d45552253a02cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:47.556702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f32096dd-7036-412c-b0cf-5e691e217db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:47.679322 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 920/1828] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:47.698289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2dd84-d437-4e25-a36e-2f01ee0dcd0d None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.701018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2dd84-d437-4e25-a36e-2f01ee0dcd0d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.701408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2dd84-d437-4e25-a36e-2f01ee0dcd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.738479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:47.748838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d7a2dd84-d437-4e25-a36e-2f01ee0dcd0d None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:47.763866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d7a2dd84-d437-4e25-a36e-2f01ee0dcd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:47.772900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 909/1829] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:47.783221 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32096dd-7036-412c-b0cf-5e691e217db3 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:47.784710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f32096dd-7036-412c-b0cf-5e691e217db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:47.792186 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 921/1830] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:47.800871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2dd84-d437-4e25-a36e-2f01ee0dcd0d None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:47.814069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32096dd-7036-412c-b0cf-5e691e217db3 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:47.817836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2dd84-d437-4e25-a36e-2f01ee0dcd0d None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:47.825419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ce8a9-3325-4cab-81b7-595d4c780fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:47.826345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ce8a9-3325-4cab-81b7-595d4c780fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.826868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ce8a9-3325-4cab-81b7-595d4c780fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.827325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ce8a9-3325-4cab-81b7-595d4c780fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.828058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8c0f5-df58-4e2e-8bed-0cdd74491789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:47.828551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ce8a9-3325-4cab-81b7-595d4c780fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:47.829444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8c0f5-df58-4e2e-8bed-0cdd74491789 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.829444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8c0f5-df58-4e2e-8bed-0cdd74491789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.829444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8c0f5-df58-4e2e-8bed-0cdd74491789 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.829729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ce8a9-3325-4cab-81b7-595d4c780fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:47.830360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8c0f5-df58-4e2e-8bed-0cdd74491789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:47.834823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8c0f5-df58-4e2e-8bed-0cdd74491789 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:47.835365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ce8a9-3325-4cab-81b7-595d4c780fbe admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:47.859172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 922/1831] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:47.864067 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ce8a9-3325-4cab-81b7-595d4c780fbe admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:47.893135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ce8a9-3325-4cab-81b7-595d4c780fbe admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:47.904716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 910/1832] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:47 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:07:47.905914 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8c0f5-df58-4e2e-8bed-0cdd74491789 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:47.907485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2c0bf-1402-4f95-a6e9-c3b834729efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:47.909255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c0bf-1402-4f95-a6e9-c3b834729efb admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.910207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c0bf-1402-4f95-a6e9-c3b834729efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.910207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2c0bf-1402-4f95-a6e9-c3b834729efb admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.913335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2c0bf-1402-4f95-a6e9-c3b834729efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:47.917153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2c0bf-1402-4f95-a6e9-c3b834729efb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:47.977276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 923/1833] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:47 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:47.978701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb8319-a1a4-4cd9-a005-18bf94ce6603 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:47.978993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb8319-a1a4-4cd9-a005-18bf94ce6603 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:47.979315 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb8319-a1a4-4cd9-a005-18bf94ce6603 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:47.983056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 924/1834] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:47.985588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb8319-a1a4-4cd9-a005-18bf94ce6603 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:48.028000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:48.066309 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8c0f5-df58-4e2e-8bed-0cdd74491789 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:48.153561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb8319-a1a4-4cd9-a005-18bf94ce6603 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:48.180052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f28fb-2acb-4bc2-b47b-88ae38da0420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:48.183144 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a2343-e47e-479b-9f39-9e084cd53f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:48.184002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2343-e47e-479b-9f39-9e084cd53f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:48.184423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2343-e47e-479b-9f39-9e084cd53f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:48.184993 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a2343-e47e-479b-9f39-9e084cd53f46 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:48.185999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a2343-e47e-479b-9f39-9e084cd53f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:48.188392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a2343-e47e-479b-9f39-9e084cd53f46 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:48.194226 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f28fb-2acb-4bc2-b47b-88ae38da0420 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:48.194612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f28fb-2acb-4bc2-b47b-88ae38da0420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:48.194902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f28fb-2acb-4bc2-b47b-88ae38da0420 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:48.207439 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f28fb-2acb-4bc2-b47b-88ae38da0420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:48.210475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f28fb-2acb-4bc2-b47b-88ae38da0420 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:48.232801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 911/1835] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:47 2022] POST /identity/v3/users => generated 289 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:48.235555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e52a-1a5c-4b2d-b726-531f2b18a767 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:48.237979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e52a-1a5c-4b2d-b726-531f2b18a767 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:48.237979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52e52a-1a5c-4b2d-b726-531f2b18a767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:48.262929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 925/1836] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:47 2022] POST /identity/v3/users => generated 291 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:48.269736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f28fb-2acb-4bc2-b47b-88ae38da0420 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:48.283102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2b52e52a-1a5c-4b2d-b726-531f2b18a767 None None] MFA Rules not processed for user `0a5e0b53aafc4bf3a23a7882ed12a89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:48.284450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2b52e52a-1a5c-4b2d-b726-531f2b18a767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:48.292994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f28fb-2acb-4bc2-b47b-88ae38da0420 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:48.317535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2ca0-dcf9-490f-a646-a48bf08d2ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:48.318268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2ca0-dcf9-490f-a646-a48bf08d2ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:48.320651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2ca0-dcf9-490f-a646-a48bf08d2ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:48.320944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2ca0-dcf9-490f-a646-a48bf08d2ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:48.324090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2ca0-dcf9-490f-a646-a48bf08d2ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:48.329274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2ca0-dcf9-490f-a646-a48bf08d2ee6 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:48.374865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 926/1837] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:48.376019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2ca0-dcf9-490f-a646-a48bf08d2ee6 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:48.402275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2ca0-dcf9-490f-a646-a48bf08d2ee6 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:48.414176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae763b-ce4d-4939-9e89-baccba4b553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:48.415916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae763b-ce4d-4939-9e89-baccba4b553d admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:48.417733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae763b-ce4d-4939-9e89-baccba4b553d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:48.418881 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae763b-ce4d-4939-9e89-baccba4b553d admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:48.419767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae763b-ce4d-4939-9e89-baccba4b553d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:48.423037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae763b-ce4d-4939-9e89-baccba4b553d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:48.452129 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 927/1838] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:48.455598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae763b-ce4d-4939-9e89-baccba4b553d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:48.457295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 912/1839] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:07:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:48.459403 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e52a-1a5c-4b2d-b726-531f2b18a767 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:48.487648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae763b-ce4d-4939-9e89-baccba4b553d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:48.493211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52e52a-1a5c-4b2d-b726-531f2b18a767 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:48.505311 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5ebb-4481-4f79-9875-72df8cdd4753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:48.506569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5ebb-4481-4f79-9875-72df8cdd4753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:48.507019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5ebb-4481-4f79-9875-72df8cdd4753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:48.507370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5ebb-4481-4f79-9875-72df8cdd4753 admin admin] PATH_INFO: `/v3/projects/0df50f28ae6940ec909c7a7563b4dafc/users/f6e4e5aad96b422b9f563dc735d6030a/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:48.512113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0390912-71a6-4dbb-8faa-242fe97e9289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:48.513481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390912-71a6-4dbb-8faa-242fe97e9289 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:48.513777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390912-71a6-4dbb-8faa-242fe97e9289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:48.516407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390912-71a6-4dbb-8faa-242fe97e9289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:48.518509 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0390912-71a6-4dbb-8faa-242fe97e9289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:48.521537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0390912-71a6-4dbb-8faa-242fe97e9289 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:48.548390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 913/1840] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:48.549424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f5ebb-4481-4f79-9875-72df8cdd4753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df50f28ae6940ec909c7a7563b4dafc, user_id=f6e4e5aad96b422b9f563dc735d6030a, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:48.549876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0390912-71a6-4dbb-8faa-242fe97e9289 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:48.551628 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a0390912-71a6-4dbb-8faa-242fe97e9289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:48.552612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f5ebb-4481-4f79-9875-72df8cdd4753 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:48.579558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0390912-71a6-4dbb-8faa-242fe97e9289 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:48.582941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 928/1841] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:48 2022] PUT /identity/v3/projects/0df50f28ae6940ec909c7a7563b4dafc/users/f6e4e5aad96b422b9f563dc735d6030a/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:48.584185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5ebb-4481-4f79-9875-72df8cdd4753 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:48.739287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5ebb-4481-4f79-9875-72df8cdd4753 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:48.750454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b8045-2f96-4dfe-b8f4-8e8cb0114ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:48.751232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b8045-2f96-4dfe-b8f4-8e8cb0114ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:48.751741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b8045-2f96-4dfe-b8f4-8e8cb0114ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:48.752120 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b8045-2f96-4dfe-b8f4-8e8cb0114ca7 admin admin] PATH_INFO: `/v3/projects/b444fb4790a049e892052a3bee8304a2/users/dc3c999a699c4d4baa905902fcbbc8ad/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:48.773551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ecb93-3295-4cd7-8371-dcd494551899 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e0b53aafc4bf3a23a7882ed12a89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:48.775730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ecb93-3295-4cd7-8371-dcd494551899 service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:48.776088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ecb93-3295-4cd7-8371-dcd494551899 service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:48.776617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:48.777104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ecb93-3295-4cd7-8371-dcd494551899 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:48.797777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b8045-2f96-4dfe-b8f4-8e8cb0114ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b444fb4790a049e892052a3bee8304a2, user_id=dc3c999a699c4d4baa905902fcbbc8ad, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:48.800703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b8045-2f96-4dfe-b8f4-8e8cb0114ca7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:48.854626 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 929/1842] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:48 2022] PUT /identity/v3/projects/b444fb4790a049e892052a3bee8304a2/users/dc3c999a699c4d4baa905902fcbbc8ad/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:48.869072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b8045-2f96-4dfe-b8f4-8e8cb0114ca7 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:48.872739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ecb93-3295-4cd7-8371-dcd494551899 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:48.875454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ecb93-3295-4cd7-8371-dcd494551899 service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:48.922870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 914/1843] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:48.924238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366cb5-8947-46e7-8a5c-7fe1c2773266 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:48.927751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366cb5-8947-46e7-8a5c-7fe1c2773266 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:48.928080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af366cb5-8947-46e7-8a5c-7fe1c2773266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:48.956713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:49.051648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-af366cb5-8947-46e7-8a5c-7fe1c2773266 None None] MFA Rules not processed for user `dc3c999a699c4d4baa905902fcbbc8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:49.053240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-af366cb5-8947-46e7-8a5c-7fe1c2773266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:49.103904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b8045-2f96-4dfe-b8f4-8e8cb0114ca7 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:49.117753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd318348-7de1-419b-b091-2d3cd4d0a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:49.118634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318348-7de1-419b-b091-2d3cd4d0a067 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.118939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318348-7de1-419b-b091-2d3cd4d0a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.119281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd318348-7de1-419b-b091-2d3cd4d0a067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.119951 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd318348-7de1-419b-b091-2d3cd4d0a067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:49.135687 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd318348-7de1-419b-b091-2d3cd4d0a067 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:49.160536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 930/1844] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:49.166287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd318348-7de1-419b-b091-2d3cd4d0a067 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:49.195200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd318348-7de1-419b-b091-2d3cd4d0a067 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:49.206682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4cc88-5276-46e1-8883-bc874c9e7e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:49.207148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 915/1845] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:49.211285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af366cb5-8947-46e7-8a5c-7fe1c2773266 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:49.212469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4cc88-5276-46e1-8883-bc874c9e7e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.212767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4cc88-5276-46e1-8883-bc874c9e7e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.213684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4cc88-5276-46e1-8883-bc874c9e7e51 admin admin] PATH_INFO: `/v3/projects/0df50f28ae6940ec909c7a7563b4dafc/users/f6e4e5aad96b422b9f563dc735d6030a/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.216095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4cc88-5276-46e1-8883-bc874c9e7e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df50f28ae6940ec909c7a7563b4dafc, user_id=f6e4e5aad96b422b9f563dc735d6030a, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:49.224740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af366cb5-8947-46e7-8a5c-7fe1c2773266 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:49.238947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091eae9-e915-4a3b-9e77-5c20ce61f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:49.241326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091eae9-e915-4a3b-9e77-5c20ce61f205 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.241727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091eae9-e915-4a3b-9e77-5c20ce61f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.242095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4cc88-5276-46e1-8883-bc874c9e7e51 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:49.243442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091eae9-e915-4a3b-9e77-5c20ce61f205 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.244626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091eae9-e915-4a3b-9e77-5c20ce61f205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:49.254762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091eae9-e915-4a3b-9e77-5c20ce61f205 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:49.288080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 931/1846] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:49 2022] PUT /identity/v3/projects/0df50f28ae6940ec909c7a7563b4dafc/users/f6e4e5aad96b422b9f563dc735d6030a/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:49.290164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78f939-7e40-4c60-81b4-3e0440701a84 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.290747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78f939-7e40-4c60-81b4-3e0440701a84 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.291045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78f939-7e40-4c60-81b4-3e0440701a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.332744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 916/1847] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:49 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:49.333458 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091eae9-e915-4a3b-9e77-5c20ce61f205 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:49.421395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-da78f939-7e40-4c60-81b4-3e0440701a84 None None] MFA Rules not processed for user `f6e4e5aad96b422b9f563dc735d6030a`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:49.422779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-da78f939-7e40-4c60-81b4-3e0440701a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:49.494819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091eae9-e915-4a3b-9e77-5c20ce61f205 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:49.508133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523fe27-24d0-4252-b088-69369b8a3dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:49.509214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523fe27-24d0-4252-b088-69369b8a3dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.510011 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523fe27-24d0-4252-b088-69369b8a3dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.510495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523fe27-24d0-4252-b088-69369b8a3dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.511394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523fe27-24d0-4252-b088-69369b8a3dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:49.527586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523fe27-24d0-4252-b088-69369b8a3dc9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:49.575703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 917/1848] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:49 2022] POST /identity/v3/users => generated 298 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:49.578266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523fe27-24d0-4252-b088-69369b8a3dc9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:49.598998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523fe27-24d0-4252-b088-69369b8a3dc9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:49.607098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9edc9-8b45-4ab0-a65b-659b04de14eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:49.607858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9edc9-8b45-4ab0-a65b-659b04de14eb admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.608147 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9edc9-8b45-4ab0-a65b-659b04de14eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.608468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9edc9-8b45-4ab0-a65b-659b04de14eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.609652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9edc9-8b45-4ab0-a65b-659b04de14eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:49.613077 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9edc9-8b45-4ab0-a65b-659b04de14eb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:49.625318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 918/1849] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:49.632299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9edc9-8b45-4ab0-a65b-659b04de14eb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:49.637585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 932/1850] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:49.649741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78f939-7e40-4c60-81b4-3e0440701a84 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:49.678605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9edc9-8b45-4ab0-a65b-659b04de14eb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:49.699187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8290a-f083-473c-ad5c-c66d2d454c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:49.700140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8290a-f083-473c-ad5c-c66d2d454c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.700507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8290a-f083-473c-ad5c-c66d2d454c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.706104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8290a-f083-473c-ad5c-c66d2d454c3e admin admin] PATH_INFO: `/v3/projects/de23ef5a167e439c896c3e76074008fb/users/c2a38dc80db34d9db6e6b0cab5705696/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.732496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8290a-f083-473c-ad5c-c66d2d454c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de23ef5a167e439c896c3e76074008fb, user_id=c2a38dc80db34d9db6e6b0cab5705696, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:49.735583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8290a-f083-473c-ad5c-c66d2d454c3e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:49.767367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 919/1851] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:49 2022] PUT /identity/v3/projects/de23ef5a167e439c896c3e76074008fb/users/c2a38dc80db34d9db6e6b0cab5705696/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:49.768636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8290a-f083-473c-ad5c-c66d2d454c3e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:49.774473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78f939-7e40-4c60-81b4-3e0440701a84 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:49.801170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:49.850354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:49.895619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2e98a-cee8-416c-89fb-da32c3da04fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:49.899195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e98a-cee8-416c-89fb-da32c3da04fe service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.899681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e98a-cee8-416c-89fb-da32c3da04fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.900200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2e98a-cee8-416c-89fb-da32c3da04fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.946530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8290a-f083-473c-ad5c-c66d2d454c3e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:49.958594 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fffd8-ec89-401a-ad47-0d9fc16dc915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:49.959788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fffd8-ec89-401a-ad47-0d9fc16dc915 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:49.960228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fffd8-ec89-401a-ad47-0d9fc16dc915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:49.960698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fffd8-ec89-401a-ad47-0d9fc16dc915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:49.963534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fffd8-ec89-401a-ad47-0d9fc16dc915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:49.965961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fffd8-ec89-401a-ad47-0d9fc16dc915 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:49.999867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 920/1852] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:50.001846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fffd8-ec89-401a-ad47-0d9fc16dc915 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:50.030809 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fffd8-ec89-401a-ad47-0d9fc16dc915 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:50.045455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efe87a-6586-4868-a0e4-eb44131e2ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:50.046519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efe87a-6586-4868-a0e4-eb44131e2ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:50.048876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efe87a-6586-4868-a0e4-eb44131e2ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:50.049282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efe87a-6586-4868-a0e4-eb44131e2ea2 admin admin] PATH_INFO: `/v3/projects/de23ef5a167e439c896c3e76074008fb/users/c2a38dc80db34d9db6e6b0cab5705696/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:50.054414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efe87a-6586-4868-a0e4-eb44131e2ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de23ef5a167e439c896c3e76074008fb, user_id=c2a38dc80db34d9db6e6b0cab5705696, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:50.059752 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efe87a-6586-4868-a0e4-eb44131e2ea2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:50.084754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2e98a-cee8-416c-89fb-da32c3da04fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:50.094452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2e98a-cee8-416c-89fb-da32c3da04fe service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:50.106002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 921/1853] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:50 2022] PUT /identity/v3/projects/de23ef5a167e439c896c3e76074008fb/users/c2a38dc80db34d9db6e6b0cab5705696/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:50.108055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76fee7-8e82-4be8-a7e9-447c11bfdfd4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:50.109698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76fee7-8e82-4be8-a7e9-447c11bfdfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:50.110168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76fee7-8e82-4be8-a7e9-447c11bfdfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:50.134773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 933/1854] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:50.216503 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5f76fee7-8e82-4be8-a7e9-447c11bfdfd4 None None] MFA Rules not processed for user `c2a38dc80db34d9db6e6b0cab5705696`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:50.221018 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5f76fee7-8e82-4be8-a7e9-447c11bfdfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:50.377014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2e98a-cee8-416c-89fb-da32c3da04fe service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:50.398447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2e98a-cee8-416c-89fb-da32c3da04fe service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:50.513381 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 922/1855] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:50.514517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76fee7-8e82-4be8-a7e9-447c11bfdfd4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:50.519692 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5f76fee7-8e82-4be8-a7e9-447c11bfdfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:50.589124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85d3e8-8df8-453d-a27b-26a7eca18279 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:50.593787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85d3e8-8df8-453d-a27b-26a7eca18279 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:50.594092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85d3e8-8df8-453d-a27b-26a7eca18279 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:50.594663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85d3e8-8df8-453d-a27b-26a7eca18279 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:50.700499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76fee7-8e82-4be8-a7e9-447c11bfdfd4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:50.708231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef70709-2e66-4956-a047-3e955a9b3970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:50.709370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef70709-2e66-4956-a047-3e955a9b3970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:50.709769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef70709-2e66-4956-a047-3e955a9b3970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:50.710155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef70709-2e66-4956-a047-3e955a9b3970 admin admin] PATH_INFO: `/v3/users/e90236aa99264ace8afa5e0c5d1a47c6` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:50.711858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef70709-2e66-4956-a047-3e955a9b3970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e90236aa99264ace8afa5e0c5d1a47c6)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:50.716145 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef70709-2e66-4956-a047-3e955a9b3970 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:50.807677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:50.833778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-eef70709-2e66-4956-a047-3e955a9b3970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e90236aa99264ace8afa5e0c5d1a47c6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:50.835323 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85d3e8-8df8-453d-a27b-26a7eca18279 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:50.836249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-eef70709-2e66-4956-a047-3e955a9b3970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e90236aa99264ace8afa5e0c5d1a47c6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:50.836858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85d3e8-8df8-453d-a27b-26a7eca18279 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:50.851055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-eef70709-2e66-4956-a047-3e955a9b3970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e90236aa99264ace8afa5e0c5d1a47c6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:50.864591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-eef70709-2e66-4956-a047-3e955a9b3970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e90236aa99264ace8afa5e0c5d1a47c6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:50.875641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-eef70709-2e66-4956-a047-3e955a9b3970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e90236aa99264ace8afa5e0c5d1a47c6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:50.887406 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 934/1856] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:50.889497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85d3e8-8df8-453d-a27b-26a7eca18279 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:50.895489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0d85d3e8-8df8-453d-a27b-26a7eca18279 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:50.917971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 923/1857] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:50 2022] DELETE /identity/v3/users/e90236aa99264ace8afa5e0c5d1a47c6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:50.934192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85d3e8-8df8-453d-a27b-26a7eca18279 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:51.019968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:51.187061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abb151-13a6-4de5-b1ca-eca79510bd85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:51.188130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb151-13a6-4de5-b1ca-eca79510bd85 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:51.192521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb151-13a6-4de5-b1ca-eca79510bd85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:51.192977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb151-13a6-4de5-b1ca-eca79510bd85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:51.197809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-57abb151-13a6-4de5-b1ca-eca79510bd85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:51.397222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21992-0f18-4809-8a28-35a3ab638a19 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:51.397571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21992-0f18-4809-8a28-35a3ab638a19 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:51.398049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21992-0f18-4809-8a28-35a3ab638a19 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:51.399691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 924/1858] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:07:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:51.461710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abb151-13a6-4de5-b1ca-eca79510bd85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:51.468562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf2530-6ebc-4544-aec5-10436bdde893 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:51.469469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf2530-6ebc-4544-aec5-10436bdde893 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:51.470107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf2530-6ebc-4544-aec5-10436bdde893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:51.485976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abb151-13a6-4de5-b1ca-eca79510bd85 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:51.542849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-12bf2530-6ebc-4544-aec5-10436bdde893 None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:51.544650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-12bf2530-6ebc-4544-aec5-10436bdde893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:51.549446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 935/1859] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:51.550847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abb151-13a6-4de5-b1ca-eca79510bd85 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:51.553168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-57abb151-13a6-4de5-b1ca-eca79510bd85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:51.677117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abb151-13a6-4de5-b1ca-eca79510bd85 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:51.700441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:51.703276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:51.704465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:51.704863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] PATH_INFO: `/v3/users/f3a023e3f7f0478d999869a4cac1514c` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:51.708306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a023e3f7f0478d999869a4cac1514c)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:51.711208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:51.824003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 925/1860] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:07:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:51.828927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf2530-6ebc-4544-aec5-10436bdde893 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:51.832941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-12bf2530-6ebc-4544-aec5-10436bdde893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:51.862100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf2530-6ebc-4544-aec5-10436bdde893 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:51.867514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a023e3f7f0478d999869a4cac1514c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:51.868714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cafbb-d18c-48d8-99c7-bd5c417cbef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:51.869528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cafbb-d18c-48d8-99c7-bd5c417cbef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:51.870091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cafbb-d18c-48d8-99c7-bd5c417cbef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:51.870394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cafbb-d18c-48d8-99c7-bd5c417cbef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:51.873846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e24cafbb-d18c-48d8-99c7-bd5c417cbef0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:51.890698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a023e3f7f0478d999869a4cac1514c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:51.893879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a023e3f7f0478d999869a4cac1514c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:51.896461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a023e3f7f0478d999869a4cac1514c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:51.931232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:51.938112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a023e3f7f0478d999869a4cac1514c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:51.968935 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cafbb-d18c-48d8-99c7-bd5c417cbef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:51.971000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cafbb-d18c-48d8-99c7-bd5c417cbef0 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:51.976243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 936/1861] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:51 2022] DELETE /identity/v3/users/f3a023e3f7f0478d999869a4cac1514c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:51.982316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:51.986318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 926/1862] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:51.986641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:51.987493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7f9ad-e03a-49c5-b8b4-46e5871c4f32 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:51.987843 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7f9ad-e03a-49c5-b8b4-46e5871c4f32 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:51.988211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7f9ad-e03a-49c5-b8b4-46e5871c4f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:52.024196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-dcb7f9ad-e03a-49c5-b8b4-46e5871c4f32 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:52.025696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dcb7f9ad-e03a-49c5-b8b4-46e5871c4f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:52.138693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:52.188415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daedba-61b1-4c39-b0fd-e3b5f25dc3eb admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:52.190459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 927/1863] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:52.201035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6a007-0db9-4f4e-bd1a-41184c618acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:52.202002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6a007-0db9-4f4e-bd1a-41184c618acc service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:52.202278 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6a007-0db9-4f4e-bd1a-41184c618acc service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:52.202867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6a007-0db9-4f4e-bd1a-41184c618acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:52.205692 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ddc6a007-0db9-4f4e-bd1a-41184c618acc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:52.234089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6a007-0db9-4f4e-bd1a-41184c618acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:52.241247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc6a007-0db9-4f4e-bd1a-41184c618acc service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:52.278230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 937/1864] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:52.297339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7f9ad-e03a-49c5-b8b4-46e5871c4f32 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:52.299494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dcb7f9ad-e03a-49c5-b8b4-46e5871c4f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:52.570067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7f9ad-e03a-49c5-b8b4-46e5871c4f32 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:52.603224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdf8c8-77bb-49c1-9176-8c5b0fbed48b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:52.604089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdf8c8-77bb-49c1-9176-8c5b0fbed48b service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:52.605657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdf8c8-77bb-49c1-9176-8c5b0fbed48b service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:52.606001 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdf8c8-77bb-49c1-9176-8c5b0fbed48b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:52.619021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6a007-0db9-4f4e-bd1a-41184c618acc service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:52.621920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ddc6a007-0db9-4f4e-bd1a-41184c618acc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:52.676049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdf8c8-77bb-49c1-9176-8c5b0fbed48b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:52.677786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdf8c8-77bb-49c1-9176-8c5b0fbed48b service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:52.696375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6a007-0db9-4f4e-bd1a-41184c618acc service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:52.710282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 928/1865] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:52.711767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:52.712696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:52.713002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:52.713273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] PATH_INFO: `/v3/projects/507d1be345db43f29b2fc7c49423aac1` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:52.714579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507d1be345db43f29b2fc7c49423aac1)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:52.715646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdf8c8-77bb-49c1-9176-8c5b0fbed48b service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:52.716809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:52.718385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e1bdf8c8-77bb-49c1-9176-8c5b0fbed48b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:52.756696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdf8c8-77bb-49c1-9176-8c5b0fbed48b service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:52.776406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1f598-57e3-43f7-a91b-06291e5447e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:52.781392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1f598-57e3-43f7-a91b-06291e5447e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:52.783180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1f598-57e3-43f7-a91b-06291e5447e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:52.783809 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1f598-57e3-43f7-a91b-06291e5447e1 admin admin] PATH_INFO: `/v3/users/dc3c999a699c4d4baa905902fcbbc8ad` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:52.788065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1f598-57e3-43f7-a91b-06291e5447e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc3c999a699c4d4baa905902fcbbc8ad)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:52.799460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1f598-57e3-43f7-a91b-06291e5447e1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:52.861084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507d1be345db43f29b2fc7c49423aac1', 'request_id': 'req-93e491f5-8125-4174-9863-917628357b45'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:52.876082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507d1be345db43f29b2fc7c49423aac1', 'request_id': 'req-93e491f5-8125-4174-9863-917628357b45'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:52.895955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507d1be345db43f29b2fc7c49423aac1', 'request_id': 'req-93e491f5-8125-4174-9863-917628357b45'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:52.927579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] The token cache is being invalidate because project 507d1be345db43f29b2fc7c49423aac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:52.928091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:52.929949 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:52.933870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5be1f598-57e3-43f7-a91b-06291e5447e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc3c999a699c4d4baa905902fcbbc8ad'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:52.936138 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5be1f598-57e3-43f7-a91b-06291e5447e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc3c999a699c4d4baa905902fcbbc8ad'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:52.936560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 938/1866] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:52 2022] DELETE /identity/v3/projects/507d1be345db43f29b2fc7c49423aac1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:07:52.948730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:52.951483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:52.971742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5be1f598-57e3-43f7-a91b-06291e5447e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc3c999a699c4d4baa905902fcbbc8ad'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:52.995038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5be1f598-57e3-43f7-a91b-06291e5447e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc3c999a699c4d4baa905902fcbbc8ad'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:52.995683 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5be1f598-57e3-43f7-a91b-06291e5447e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc3c999a699c4d4baa905902fcbbc8ad'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:53.057671 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 929/1867] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:52 2022] DELETE /identity/v3/users/dc3c999a699c4d4baa905902fcbbc8ad => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:53.063355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f672-75ec-4378-97ee-325fdb9f9740 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:53.065184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f672-75ec-4378-97ee-325fdb9f9740 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:53.066278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f672-75ec-4378-97ee-325fdb9f9740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:53.122616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:53.128466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e491f5-8125-4174-9863-917628357b45 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:53.142466 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9bc4f672-75ec-4378-97ee-325fdb9f9740 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:53.144102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9bc4f672-75ec-4378-97ee-325fdb9f9740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:53.256103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:53.257182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:53.257579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:53.257970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] PATH_INFO: `/v3/users/6821eb45aa014866b60fec017acb884b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:53.262486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6821eb45aa014866b60fec017acb884b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:53.266799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:53.325963 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:53.360679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 930/1868] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:53.379433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4f672-75ec-4378-97ee-325fdb9f9740 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:53.381429 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9bc4f672-75ec-4378-97ee-325fdb9f9740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:53.416837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6821eb45aa014866b60fec017acb884b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:53.444645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6821eb45aa014866b60fec017acb884b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:53.445533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6821eb45aa014866b60fec017acb884b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:53.446187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6821eb45aa014866b60fec017acb884b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:53.462091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6821eb45aa014866b60fec017acb884b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:53.487934 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 939/1869] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:52 2022] DELETE /identity/v3/users/6821eb45aa014866b60fec017acb884b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:53.524090 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4f672-75ec-4378-97ee-325fdb9f9740 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:53.630081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164a7ff-2ca1-4c1b-acd2-f3a94e71a900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:53.631732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a7ff-2ca1-4c1b-acd2-f3a94e71a900 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:53.632598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a7ff-2ca1-4c1b-acd2-f3a94e71a900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:53.633562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164a7ff-2ca1-4c1b-acd2-f3a94e71a900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:53.639949 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a164a7ff-2ca1-4c1b-acd2-f3a94e71a900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:53.733928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164a7ff-2ca1-4c1b-acd2-f3a94e71a900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:53.735466 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164a7ff-2ca1-4c1b-acd2-f3a94e71a900 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:53.747210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 931/1870] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:07:53.853368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:53.857646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:53.881761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd4e16-78b5-4e25-9979-c257f4030ea9 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:53.887186 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:53.888457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:53.888457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:53.888786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] PATH_INFO: `/v3/projects/bf13abf426a2475d977fa948bb746f71` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:53.889902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf13abf426a2475d977fa948bb746f71)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:53.892057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:53.961396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf13abf426a2475d977fa948bb746f71', 'request_id': 'req-83285e58-2f16-404d-97cd-b67043b5b7b6'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:53.972590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf13abf426a2475d977fa948bb746f71', 'request_id': 'req-83285e58-2f16-404d-97cd-b67043b5b7b6'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:53.981983 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf13abf426a2475d977fa948bb746f71', 'request_id': 'req-83285e58-2f16-404d-97cd-b67043b5b7b6'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.000690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] The token cache is being invalidate because project bf13abf426a2475d977fa948bb746f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:54.001135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.001953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.003637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 940/1871] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:53 2022] DELETE /identity/v3/projects/bf13abf426a2475d977fa948bb746f71 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:54.008088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164a7ff-2ca1-4c1b-acd2-f3a94e71a900 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:54.019338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164a7ff-2ca1-4c1b-acd2-f3a94e71a900 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:54.020491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:54.023140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:54.045655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:54.121087 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84a974-bd4b-4d97-9d15-c4c1ba99d98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:54.121994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84a974-bd4b-4d97-9d15-c4c1ba99d98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.122282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84a974-bd4b-4d97-9d15-c4c1ba99d98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.122558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84a974-bd4b-4d97-9d15-c4c1ba99d98c admin admin] PATH_INFO: `/v3/users/d3a9f2a223fc47e0a73633ea57239b07` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.127183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84a974-bd4b-4d97-9d15-c4c1ba99d98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a9f2a223fc47e0a73633ea57239b07)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:54.129383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84a974-bd4b-4d97-9d15-c4c1ba99d98c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:54.137594 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:54.143182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83285e58-2f16-404d-97cd-b67043b5b7b6 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:54.150589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:54.152941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.153566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.154874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] PATH_INFO: `/v3/projects/7a6a3ce2d67f4faa84ec3866657371b9` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.172724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6a3ce2d67f4faa84ec3866657371b9)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:54.176093 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:54.205313 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7a84a974-bd4b-4d97-9d15-c4c1ba99d98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a9f2a223fc47e0a73633ea57239b07'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.207241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7a84a974-bd4b-4d97-9d15-c4c1ba99d98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a9f2a223fc47e0a73633ea57239b07'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.218245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7a84a974-bd4b-4d97-9d15-c4c1ba99d98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a9f2a223fc47e0a73633ea57239b07'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.231931 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7a84a974-bd4b-4d97-9d15-c4c1ba99d98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a9f2a223fc47e0a73633ea57239b07'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.232686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7a84a974-bd4b-4d97-9d15-c4c1ba99d98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a9f2a223fc47e0a73633ea57239b07'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.240005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6a3ce2d67f4faa84ec3866657371b9', 'request_id': 'req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.247754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6a3ce2d67f4faa84ec3866657371b9', 'request_id': 'req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.257672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6a3ce2d67f4faa84ec3866657371b9', 'request_id': 'req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.265496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 932/1872] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:54 2022] DELETE /identity/v3/users/d3a9f2a223fc47e0a73633ea57239b07 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:54.284199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] The token cache is being invalidate because project 7a6a3ce2d67f4faa84ec3866657371b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:54.284856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.285948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-6f98ed0f-6eac-4724-bc3f-f779e4ed54c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.291553 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 941/1873] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:54 2022] DELETE /identity/v3/projects/7a6a3ce2d67f4faa84ec3866657371b9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:54.294478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d116a62-7909-469d-9c52-2ba1545cb8da None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.294478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d116a62-7909-469d-9c52-2ba1545cb8da None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.294999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d116a62-7909-469d-9c52-2ba1545cb8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.319294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1d116a62-7909-469d-9c52-2ba1545cb8da None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:54.329941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1d116a62-7909-469d-9c52-2ba1545cb8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:54.400814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 933/1874] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:54.410129 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c038b1-871b-441f-b6d3-e4410327558a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.410480 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c038b1-871b-441f-b6d3-e4410327558a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.410728 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c038b1-871b-441f-b6d3-e4410327558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.434896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-72c038b1-871b-441f-b6d3-e4410327558a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:54.436437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-72c038b1-871b-441f-b6d3-e4410327558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:54.456620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 942/1875] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:54.458783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d116a62-7909-469d-9c52-2ba1545cb8da None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:54.489895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d116a62-7909-469d-9c52-2ba1545cb8da None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:54.495628 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a422ed-d7a7-4aa0-b402-f764c17527a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:54.496780 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a422ed-d7a7-4aa0-b402-f764c17527a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.497065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a422ed-d7a7-4aa0-b402-f764c17527a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.497339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a422ed-d7a7-4aa0-b402-f764c17527a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.498210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a422ed-d7a7-4aa0-b402-f764c17527a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:54.498526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a422ed-d7a7-4aa0-b402-f764c17527a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:54.500169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a422ed-d7a7-4aa0-b402-f764c17527a2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:54.518746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 934/1876] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:54.519920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c038b1-871b-441f-b6d3-e4410327558a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:54.532124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c038b1-871b-441f-b6d3-e4410327558a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:54.537860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc953c-6609-4e41-b0d4-115a8c3a1496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:54.538032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc953c-6609-4e41-b0d4-115a8c3a1496 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.538375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc953c-6609-4e41-b0d4-115a8c3a1496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.538657 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc953c-6609-4e41-b0d4-115a8c3a1496 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.539363 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc953c-6609-4e41-b0d4-115a8c3a1496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:54.542399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc953c-6609-4e41-b0d4-115a8c3a1496 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:54.569056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a422ed-d7a7-4aa0-b402-f764c17527a2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:54.570840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a2a422ed-d7a7-4aa0-b402-f764c17527a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:54.573044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 943/1877] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:54 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:54.577523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc953c-6609-4e41-b0d4-115a8c3a1496 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:54.591627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a422ed-d7a7-4aa0-b402-f764c17527a2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:54.649947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc953c-6609-4e41-b0d4-115a8c3a1496 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:54.656434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bcf51-9e70-473a-a59a-6f00d231502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:54.657411 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcf51-9e70-473a-a59a-6f00d231502e admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.657959 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcf51-9e70-473a-a59a-6f00d231502e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.658325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bcf51-9e70-473a-a59a-6f00d231502e admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.659220 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bcf51-9e70-473a-a59a-6f00d231502e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:54.662357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bcf51-9e70-473a-a59a-6f00d231502e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:54.667436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:54.668380 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.668738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.669171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] PATH_INFO: `/v3/projects/b444fb4790a049e892052a3bee8304a2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.670694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b444fb4790a049e892052a3bee8304a2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:54.673335 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:54.681400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:54.689002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 944/1878] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:54 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:54.693737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bcf51-9e70-473a-a59a-6f00d231502e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:54.699708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:54.711678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bcf51-9e70-473a-a59a-6f00d231502e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:54.718550 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebce43e-17ad-4561-aad0-1d87f06c692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:54.719174 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebce43e-17ad-4561-aad0-1d87f06c692e admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.719458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebce43e-17ad-4561-aad0-1d87f06c692e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.719745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebce43e-17ad-4561-aad0-1d87f06c692e admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.720580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebce43e-17ad-4561-aad0-1d87f06c692e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:54.722333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebce43e-17ad-4561-aad0-1d87f06c692e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:54.736400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 945/1879] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:07:54.737328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebce43e-17ad-4561-aad0-1d87f06c692e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:54.740954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b444fb4790a049e892052a3bee8304a2', 'request_id': 'req-db165aa3-3149-447f-b526-f02c506c346d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.748513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebce43e-17ad-4561-aad0-1d87f06c692e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:54.750735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b444fb4790a049e892052a3bee8304a2', 'request_id': 'req-db165aa3-3149-447f-b526-f02c506c346d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.762966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b444fb4790a049e892052a3bee8304a2', 'request_id': 'req-db165aa3-3149-447f-b526-f02c506c346d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.782862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] The token cache is being invalidate because project b444fb4790a049e892052a3bee8304a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:54.783768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.784697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:54.789024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 935/1880] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:54 2022] DELETE /identity/v3/projects/b444fb4790a049e892052a3bee8304a2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:54.793406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:54.797272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:54.827479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af71b4d-aaef-42d4-ba69-ada65c6d94ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:54.827835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af71b4d-aaef-42d4-ba69-ada65c6d94ef admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.828181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af71b4d-aaef-42d4-ba69-ada65c6d94ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.828807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af71b4d-aaef-42d4-ba69-ada65c6d94ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.829549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af71b4d-aaef-42d4-ba69-ada65c6d94ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:54.831777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af71b4d-aaef-42d4-ba69-ada65c6d94ef admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:54.844569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 946/1881] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:54.848779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af71b4d-aaef-42d4-ba69-ada65c6d94ef admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:54.850926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9af71b4d-aaef-42d4-ba69-ada65c6d94ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:54.866268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af71b4d-aaef-42d4-ba69-ada65c6d94ef admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:54.873545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ed41a-aabb-471a-abd9-4cfadf6ea9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:54.874891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed41a-aabb-471a-abd9-4cfadf6ea9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.875249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed41a-aabb-471a-abd9-4cfadf6ea9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.875562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed41a-aabb-471a-abd9-4cfadf6ea9b3 admin admin] PATH_INFO: `/v3/projects/4f7f57682b5e4ae6ba020ed493195038/users/cf06e7683bc942df9dd9184e39e568e7/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.892818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db165aa3-3149-447f-b526-f02c506c346d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:54.896387 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ed41a-aabb-471a-abd9-4cfadf6ea9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7f57682b5e4ae6ba020ed493195038, user_id=cf06e7683bc942df9dd9184e39e568e7, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:54.901166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:54.901801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.902084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.902399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] PATH_INFO: `/v3/users/c2a38dc80db34d9db6e6b0cab5705696` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.904303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ed41a-aabb-471a-abd9-4cfadf6ea9b3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:54.904450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a38dc80db34d9db6e6b0cab5705696)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:54.906359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:54.934085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 947/1882] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:54 2022] PUT /identity/v3/projects/4f7f57682b5e4ae6ba020ed493195038/users/cf06e7683bc942df9dd9184e39e568e7/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:54.935822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2fa77-1720-4053-bffd-d3ea26b3749d None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:54.936111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2fa77-1720-4053-bffd-d3ea26b3749d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:54.936465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2fa77-1720-4053-bffd-d3ea26b3749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:54.981530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-13e2fa77-1720-4053-bffd-d3ea26b3749d None None] MFA Rules not processed for user `cf06e7683bc942df9dd9184e39e568e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:54.983163 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-13e2fa77-1720-4053-bffd-d3ea26b3749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:55.013801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a38dc80db34d9db6e6b0cab5705696'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:55.015498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a38dc80db34d9db6e6b0cab5705696'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:55.031564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a38dc80db34d9db6e6b0cab5705696'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:55.048338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a38dc80db34d9db6e6b0cab5705696'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:55.050434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a38dc80db34d9db6e6b0cab5705696'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:55.097591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 936/1883] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:54 2022] DELETE /identity/v3/users/c2a38dc80db34d9db6e6b0cab5705696 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:55.123582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 948/1884] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:55.130679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:55.132025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:55.136459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05e193-176d-4c29-badc-cf00a0df0e5f None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:55.136851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05e193-176d-4c29-badc-cf00a0df0e5f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:55.137143 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05e193-176d-4c29-badc-cf00a0df0e5f None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:55.138673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 949/1885] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:07:55.176036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d5ba-8900-4c09-b3f8-6babfd7ad596 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:55.176590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d5ba-8900-4c09-b3f8-6babfd7ad596 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:55.176907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579d5ba-8900-4c09-b3f8-6babfd7ad596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:55.193509 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:55.211343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8579d5ba-8900-4c09-b3f8-6babfd7ad596 None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:55.213890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8579d5ba-8900-4c09-b3f8-6babfd7ad596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:55.302504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfb94a-b1f6-4b57-ac65-6057565827f8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:55.309821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45550add-8120-4119-9ca7-dfc177875801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:55.310559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45550add-8120-4119-9ca7-dfc177875801 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:55.310848 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45550add-8120-4119-9ca7-dfc177875801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:55.311174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45550add-8120-4119-9ca7-dfc177875801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:55.311921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45550add-8120-4119-9ca7-dfc177875801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:55.314267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45550add-8120-4119-9ca7-dfc177875801 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:55.339164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:55.385232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 937/1886] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:55 2022] POST /identity/v3/projects => generated 369 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:07:55.386170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45550add-8120-4119-9ca7-dfc177875801 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:55.400558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 950/1887] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:07:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:55.534825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45550add-8120-4119-9ca7-dfc177875801 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:55.541073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e31ca-6313-42b6-a35d-669b8671e03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:55.541768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e31ca-6313-42b6-a35d-669b8671e03b admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:55.542055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e31ca-6313-42b6-a35d-669b8671e03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:55.542331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e31ca-6313-42b6-a35d-669b8671e03b admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:55.543568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e31ca-6313-42b6-a35d-669b8671e03b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:55.546925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e31ca-6313-42b6-a35d-669b8671e03b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:55.591582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 938/1888] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:55 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:55.595704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579d5ba-8900-4c09-b3f8-6babfd7ad596 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:55.607523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579d5ba-8900-4c09-b3f8-6babfd7ad596 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:55.612599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a929950-f328-4b86-9f34-74b2fe57ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:55.613329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a929950-f328-4b86-9f34-74b2fe57ca49 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:55.613683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a929950-f328-4b86-9f34-74b2fe57ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:55.613976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a929950-f328-4b86-9f34-74b2fe57ca49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:55.614832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a929950-f328-4b86-9f34-74b2fe57ca49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:55.616613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a929950-f328-4b86-9f34-74b2fe57ca49 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:55.631280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 951/1889] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:55.635824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e31ca-6313-42b6-a35d-669b8671e03b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:55.652872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e31ca-6313-42b6-a35d-669b8671e03b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:55.672651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a9a1-82fc-4b2e-9d4b-5e20526d1f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:55.673721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a9a1-82fc-4b2e-9d4b-5e20526d1f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:55.674053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a9a1-82fc-4b2e-9d4b-5e20526d1f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:55.674342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4a9a1-82fc-4b2e-9d4b-5e20526d1f1b admin admin] PATH_INFO: `/v3/projects/eee24d2e56a140a996377cc8ab58c619/users/bf467752b636493e95da7eca7ba630d2/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:55.695012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4a9a1-82fc-4b2e-9d4b-5e20526d1f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee24d2e56a140a996377cc8ab58c619, user_id=bf467752b636493e95da7eca7ba630d2, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:55.698475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4a9a1-82fc-4b2e-9d4b-5e20526d1f1b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:55.724464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 939/1890] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:55 2022] PUT /identity/v3/projects/eee24d2e56a140a996377cc8ab58c619/users/bf467752b636493e95da7eca7ba630d2/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:55.727913 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a929950-f328-4b86-9f34-74b2fe57ca49 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:55.741364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a929950-f328-4b86-9f34-74b2fe57ca49 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:55.825209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f45ed-8c8c-47b3-b3f5-194000cf9590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:55.825888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f45ed-8c8c-47b3-b3f5-194000cf9590 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:55.826187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f45ed-8c8c-47b3-b3f5-194000cf9590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:55.826448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f45ed-8c8c-47b3-b3f5-194000cf9590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:55.827187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f45ed-8c8c-47b3-b3f5-194000cf9590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:55.829364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f45ed-8c8c-47b3-b3f5-194000cf9590 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:55.848110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 952/1891] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:55.848199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a9a1-82fc-4b2e-9d4b-5e20526d1f1b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:55.859784 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4a9a1-82fc-4b2e-9d4b-5e20526d1f1b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:55.867612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196fcb6-bba0-409f-969c-46c74db19ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:55.869027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196fcb6-bba0-409f-969c-46c74db19ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:55.869426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196fcb6-bba0-409f-969c-46c74db19ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:55.869885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196fcb6-bba0-409f-969c-46c74db19ce5 admin admin] PATH_INFO: `/v3/projects/eee24d2e56a140a996377cc8ab58c619/users/bf467752b636493e95da7eca7ba630d2/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:55.874275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196fcb6-bba0-409f-969c-46c74db19ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee24d2e56a140a996377cc8ab58c619, user_id=bf467752b636493e95da7eca7ba630d2, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:55.877829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196fcb6-bba0-409f-969c-46c74db19ce5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:55.908517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 940/1892] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:55 2022] PUT /identity/v3/projects/eee24d2e56a140a996377cc8ab58c619/users/bf467752b636493e95da7eca7ba630d2/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:55.908663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311eb61-bbfe-4139-bfc5-1f5ca044536a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:55.909109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311eb61-bbfe-4139-bfc5-1f5ca044536a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:55.909109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311eb61-bbfe-4139-bfc5-1f5ca044536a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:55.943990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8311eb61-bbfe-4139-bfc5-1f5ca044536a None None] MFA Rules not processed for user `bf467752b636493e95da7eca7ba630d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:55.945578 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8311eb61-bbfe-4139-bfc5-1f5ca044536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.030339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196fcb6-bba0-409f-969c-46c74db19ce5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:56.032109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1196fcb6-bba0-409f-969c-46c74db19ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.107552 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 953/1893] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:56.108687 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311eb61-bbfe-4139-bfc5-1f5ca044536a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:56.110337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8311eb61-bbfe-4139-bfc5-1f5ca044536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.188055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196fcb6-bba0-409f-969c-46c74db19ce5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:56.205000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:56.206700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:56.206995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:56.207275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] PATH_INFO: `/v3/projects/b813110b57bf40bc991bf13988bbad01` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:56.209389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b813110b57bf40bc991bf13988bbad01)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:56.211312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:56.213497 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:56.223551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:56.247854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311eb61-bbfe-4139-bfc5-1f5ca044536a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:56.261329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:56.263645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:56.265198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:56.265497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] PATH_INFO: `/v3/projects/de23ef5a167e439c896c3e76074008fb` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:56.267405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de23ef5a167e439c896c3e76074008fb)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:56.270566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:56.360763 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b813110b57bf40bc991bf13988bbad01', 'request_id': 'req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:56.367417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de23ef5a167e439c896c3e76074008fb', 'request_id': 'req-ee28063b-b1b5-4c62-9047-708c77813a95'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:56.379314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b813110b57bf40bc991bf13988bbad01', 'request_id': 'req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:56.387064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de23ef5a167e439c896c3e76074008fb', 'request_id': 'req-ee28063b-b1b5-4c62-9047-708c77813a95'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:56.393712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b813110b57bf40bc991bf13988bbad01', 'request_id': 'req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:56.401394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de23ef5a167e439c896c3e76074008fb', 'request_id': 'req-ee28063b-b1b5-4c62-9047-708c77813a95'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:56.421285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] The token cache is being invalidate because project b813110b57bf40bc991bf13988bbad01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:56.424042 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:56.425450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:56.429518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 941/1894] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:56 2022] DELETE /identity/v3/projects/b813110b57bf40bc991bf13988bbad01 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:56.431396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:56.437215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.440305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] The token cache is being invalidate because project de23ef5a167e439c896c3e76074008fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:56.440695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:56.441873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ee28063b-b1b5-4c62-9047-708c77813a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:56.461537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 954/1895] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:56 2022] DELETE /identity/v3/projects/de23ef5a167e439c896c3e76074008fb => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:56.464156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dd21-5c0e-4f8a-a994-a33483e28fa5 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:56.464622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dd21-5c0e-4f8a-a994-a33483e28fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:56.466407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dd21-5c0e-4f8a-a994-a33483e28fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:56.504482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-29f9dd21-5c0e-4f8a-a994-a33483e28fa5 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:56.506935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-29f9dd21-5c0e-4f8a-a994-a33483e28fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.564672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30be08f-eda8-4e0d-a4d0-abcff3280ffb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:56.662407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924feaf8-b32a-495d-9506-39e337f2ff35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:56.663493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924feaf8-b32a-495d-9506-39e337f2ff35 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:56.670411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924feaf8-b32a-495d-9506-39e337f2ff35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:56.670411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924feaf8-b32a-495d-9506-39e337f2ff35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:56.670665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 955/1896] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:56.670665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f28f8d-da87-4a1a-a4b9-9d152264ecd8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:56.670665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f28f8d-da87-4a1a-a4b9-9d152264ecd8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:56.670864 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-924feaf8-b32a-495d-9506-39e337f2ff35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.670935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f28f8d-da87-4a1a-a4b9-9d152264ecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:56.695430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b6f28f8d-da87-4a1a-a4b9-9d152264ecd8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:56.696774 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b6f28f8d-da87-4a1a-a4b9-9d152264ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.719949 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 956/1897] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:56.728059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f28f8d-da87-4a1a-a4b9-9d152264ecd8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:56.729771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b6f28f8d-da87-4a1a-a4b9-9d152264ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.795640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:56.801532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924feaf8-b32a-495d-9506-39e337f2ff35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:56.806700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924feaf8-b32a-495d-9506-39e337f2ff35 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:56.834693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 942/1898] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:56.836598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bda1e-f5f8-4e5c-8135-e7d5be0a7680 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:56.837088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bda1e-f5f8-4e5c-8135-e7d5be0a7680 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:56.837780 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bda1e-f5f8-4e5c-8135-e7d5be0a7680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:56.867787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-834bda1e-f5f8-4e5c-8135-e7d5be0a7680 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:56.871901 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-834bda1e-f5f8-4e5c-8135-e7d5be0a7680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.885869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f28f8d-da87-4a1a-a4b9-9d152264ecd8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:56.897184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c63fb-073b-4854-b6d8-ea977ace75eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:56.897988 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c63fb-073b-4854-b6d8-ea977ace75eb service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:56.898530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c63fb-073b-4854-b6d8-ea977ace75eb service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:56.898821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c63fb-073b-4854-b6d8-ea977ace75eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:56.901198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2b2c63fb-073b-4854-b6d8-ea977ace75eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.905663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 943/1899] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:56.909733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936cd94-3c3d-4845-88fa-3b0ffb6716eb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:56.910029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936cd94-3c3d-4845-88fa-3b0ffb6716eb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:56.910310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936cd94-3c3d-4845-88fa-3b0ffb6716eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:56.922402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c63fb-073b-4854-b6d8-ea977ace75eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:56.924818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c63fb-073b-4854-b6d8-ea977ace75eb service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:56.940228 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:56.948779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 957/1900] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:56.950523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c63fb-073b-4854-b6d8-ea977ace75eb service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:56.966731 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6936cd94-3c3d-4845-88fa-3b0ffb6716eb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:56.968140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6936cd94-3c3d-4845-88fa-3b0ffb6716eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.978764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c63fb-073b-4854-b6d8-ea977ace75eb service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:56.986151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 944/1901] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:56.987626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936cd94-3c3d-4845-88fa-3b0ffb6716eb None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:56.989702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6936cd94-3c3d-4845-88fa-3b0ffb6716eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:56.993313 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343bfdf-c1f0-4bfa-890a-f5081eb880ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:56.995210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343bfdf-c1f0-4bfa-890a-f5081eb880ce admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:56.996770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343bfdf-c1f0-4bfa-890a-f5081eb880ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:56.997248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343bfdf-c1f0-4bfa-890a-f5081eb880ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:56.998825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343bfdf-c1f0-4bfa-890a-f5081eb880ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:56.999394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343bfdf-c1f0-4bfa-890a-f5081eb880ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.003795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343bfdf-c1f0-4bfa-890a-f5081eb880ce admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.006880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936cd94-3c3d-4845-88fa-3b0ffb6716eb None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.011170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62febd2-f12b-4b32-974b-658b643322ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.012169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62febd2-f12b-4b32-974b-658b643322ca service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.012583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62febd2-f12b-4b32-974b-658b643322ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.012937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62febd2-f12b-4b32-974b-658b643322ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.015610 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f62febd2-f12b-4b32-974b-658b643322ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:57.025922 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 958/1902] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:57.027117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343bfdf-c1f0-4bfa-890a-f5081eb880ce admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.041585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343bfdf-c1f0-4bfa-890a-f5081eb880ce admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.049328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3ccdc-f61d-428f-94f5-1b9fb7035281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.050153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3ccdc-f61d-428f-94f5-1b9fb7035281 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.050474 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3ccdc-f61d-428f-94f5-1b9fb7035281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.050967 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3ccdc-f61d-428f-94f5-1b9fb7035281 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.051960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3ccdc-f61d-428f-94f5-1b9fb7035281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:57.052979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3ccdc-f61d-428f-94f5-1b9fb7035281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.055337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3ccdc-f61d-428f-94f5-1b9fb7035281 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.083914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 959/1903] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:57.085702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3ccdc-f61d-428f-94f5-1b9fb7035281 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.099138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3ccdc-f61d-428f-94f5-1b9fb7035281 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.105222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7efe3f-c954-43c1-a642-31c3452d8744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.106584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62febd2-f12b-4b32-974b-658b643322ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.107040 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7efe3f-c954-43c1-a642-31c3452d8744 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.107040 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7efe3f-c954-43c1-a642-31c3452d8744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.107322 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7efe3f-c954-43c1-a642-31c3452d8744 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.108037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7efe3f-c954-43c1-a642-31c3452d8744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.108521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62febd2-f12b-4b32-974b-658b643322ca service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.109993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7efe3f-c954-43c1-a642-31c3452d8744 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.120226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 945/1904] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:57.121884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62febd2-f12b-4b32-974b-658b643322ca service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.135169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62febd2-f12b-4b32-974b-658b643322ca service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.141251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ad1b3-d273-421c-ac9d-ae6e246d0f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.142107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ad1b3-d273-421c-ac9d-ae6e246d0f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.142490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ad1b3-d273-421c-ac9d-ae6e246d0f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.142865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ad1b3-d273-421c-ac9d-ae6e246d0f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.144749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ad1b3-d273-421c-ac9d-ae6e246d0f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.147699 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ad1b3-d273-421c-ac9d-ae6e246d0f4f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.151231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 960/1905] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:57 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:57.155920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7efe3f-c954-43c1-a642-31c3452d8744 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.201082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 946/1906] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:57 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:57.203256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ad1b3-d273-421c-ac9d-ae6e246d0f4f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.261018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7efe3f-c954-43c1-a642-31c3452d8744 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.307699 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ad1b3-d273-421c-ac9d-ae6e246d0f4f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.318761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929db8a-f42c-415d-8e1a-7e2729947b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.320289 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929db8a-f42c-415d-8e1a-7e2729947b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.320711 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929db8a-f42c-415d-8e1a-7e2729947b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.321215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929db8a-f42c-415d-8e1a-7e2729947b7b admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.323607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929db8a-f42c-415d-8e1a-7e2729947b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.328976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929db8a-f42c-415d-8e1a-7e2729947b7b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.372231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a0c59-161b-4f62-a802-20cf5742557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.373259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a0c59-161b-4f62-a802-20cf5742557a admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.373635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a0c59-161b-4f62-a802-20cf5742557a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.373986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a0c59-161b-4f62-a802-20cf5742557a admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.374582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 947/1907] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:57 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:57.376659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a0c59-161b-4f62-a802-20cf5742557a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.378617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929db8a-f42c-415d-8e1a-7e2729947b7b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.378734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a0c59-161b-4f62-a802-20cf5742557a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.390145 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929db8a-f42c-415d-8e1a-7e2729947b7b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.396140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428982d-9959-4c9a-95e5-a0e53b699b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.396885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428982d-9959-4c9a-95e5-a0e53b699b09 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.397173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428982d-9959-4c9a-95e5-a0e53b699b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.397503 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428982d-9959-4c9a-95e5-a0e53b699b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.398267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428982d-9959-4c9a-95e5-a0e53b699b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.400067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428982d-9959-4c9a-95e5-a0e53b699b09 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.404389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 961/1908] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:57 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:57.408858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a0c59-161b-4f62-a802-20cf5742557a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.411311 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 948/1909] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:07:57.415258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428982d-9959-4c9a-95e5-a0e53b699b09 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.419776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a0c59-161b-4f62-a802-20cf5742557a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.424789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a71051-fa8b-4081-aee9-fc09070e2aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.425456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a71051-fa8b-4081-aee9-fc09070e2aaa admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.425565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428982d-9959-4c9a-95e5-a0e53b699b09 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.425747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a71051-fa8b-4081-aee9-fc09070e2aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.426017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a71051-fa8b-4081-aee9-fc09070e2aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.426753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a71051-fa8b-4081-aee9-fc09070e2aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.428412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a71051-fa8b-4081-aee9-fc09070e2aaa admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.430439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab246-96ac-4dce-9cbc-a7b1884c250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.431106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab246-96ac-4dce-9cbc-a7b1884c250e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.431394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab246-96ac-4dce-9cbc-a7b1884c250e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.431671 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab246-96ac-4dce-9cbc-a7b1884c250e admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.432424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ab246-96ac-4dce-9cbc-a7b1884c250e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.434559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ab246-96ac-4dce-9cbc-a7b1884c250e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.443906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 962/1910] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:57.445014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a71051-fa8b-4081-aee9-fc09070e2aaa admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.455278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 949/1911] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:57.456157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab246-96ac-4dce-9cbc-a7b1884c250e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.456798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a71051-fa8b-4081-aee9-fc09070e2aaa admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.464060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85434f8c-547f-4ac3-9f6c-79ff6f8c1287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.464797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434f8c-547f-4ac3-9f6c-79ff6f8c1287 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.465107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434f8c-547f-4ac3-9f6c-79ff6f8c1287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.465359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434f8c-547f-4ac3-9f6c-79ff6f8c1287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.466123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85434f8c-547f-4ac3-9f6c-79ff6f8c1287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.467131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab246-96ac-4dce-9cbc-a7b1884c250e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.467767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85434f8c-547f-4ac3-9f6c-79ff6f8c1287 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.473024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279d594-8cb3-4fcd-826d-775a2c62d695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.473883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279d594-8cb3-4fcd-826d-775a2c62d695 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.474178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279d594-8cb3-4fcd-826d-775a2c62d695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.474438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279d594-8cb3-4fcd-826d-775a2c62d695 admin admin] PATH_INFO: `/v3/projects/1912af67db694b498f1f822a757fcff6/users/b8e3c8cad682426db9447cf1e92bfe2f/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.484369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 963/1912] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:07:57.485839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85434f8c-547f-4ac3-9f6c-79ff6f8c1287 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.491169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279d594-8cb3-4fcd-826d-775a2c62d695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1912af67db694b498f1f822a757fcff6, user_id=b8e3c8cad682426db9447cf1e92bfe2f, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.494002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279d594-8cb3-4fcd-826d-775a2c62d695 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.498593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85434f8c-547f-4ac3-9f6c-79ff6f8c1287 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.504401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3539b-afc1-4389-986f-7cf61cc961e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.505752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3539b-afc1-4389-986f-7cf61cc961e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.506086 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3539b-afc1-4389-986f-7cf61cc961e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.506368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3539b-afc1-4389-986f-7cf61cc961e8 admin admin] PATH_INFO: `/v3/projects/945bc6396a004e77a68fa5344d534967/users/5296f8bb5e7d4deb8eca56d7abf36c58/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.518511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 950/1913] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:57 2022] PUT /identity/v3/projects/1912af67db694b498f1f822a757fcff6/users/b8e3c8cad682426db9447cf1e92bfe2f/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:57.519638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248611-bf89-4e29-bbb5-3e5677e472e5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.520010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248611-bf89-4e29-bbb5-3e5677e472e5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.520383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248611-bf89-4e29-bbb5-3e5677e472e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.524373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3539b-afc1-4389-986f-7cf61cc961e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945bc6396a004e77a68fa5344d534967, user_id=5296f8bb5e7d4deb8eca56d7abf36c58, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.526650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:57.528423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3539b-afc1-4389-986f-7cf61cc961e8 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.556662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 964/1914] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:57 2022] PUT /identity/v3/projects/945bc6396a004e77a68fa5344d534967/users/5296f8bb5e7d4deb8eca56d7abf36c58/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:07:57.569277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8e248611-bf89-4e29-bbb5-3e5677e472e5 None None] MFA Rules not processed for user `b8e3c8cad682426db9447cf1e92bfe2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:57.569612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcedc0-6700-47e7-924f-64e702f1b318 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.570013 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcedc0-6700-47e7-924f-64e702f1b318 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.570368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcedc0-6700-47e7-924f-64e702f1b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.570530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8e248611-bf89-4e29-bbb5-3e5677e472e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:57.580974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:57.611663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-43fcedc0-6700-47e7-924f-64e702f1b318 None None] MFA Rules not processed for user `5296f8bb5e7d4deb8eca56d7abf36c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:57.613123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-43fcedc0-6700-47e7-924f-64e702f1b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:57.698164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 951/1915] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:57.706986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248611-bf89-4e29-bbb5-3e5677e472e5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.709539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8e248611-bf89-4e29-bbb5-3e5677e472e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:57.770412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 965/1916] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:57.772524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcedc0-6700-47e7-924f-64e702f1b318 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.833613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248611-bf89-4e29-bbb5-3e5677e472e5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.844184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca111-3f8e-48ce-ba54-189013fe0e2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.847847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca111-3f8e-48ce-ba54-189013fe0e2b service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.848267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca111-3f8e-48ce-ba54-189013fe0e2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.848664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca111-3f8e-48ce-ba54-189013fe0e2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.860581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfca111-3f8e-48ce-ba54-189013fe0e2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.863193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfca111-3f8e-48ce-ba54-189013fe0e2b service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.876513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 952/1917] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:57.913844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca111-3f8e-48ce-ba54-189013fe0e2b service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:57.916542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcedc0-6700-47e7-924f-64e702f1b318 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.930320 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657e138-b0ef-4335-975e-67ecc815fc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.931511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657e138-b0ef-4335-975e-67ecc815fc4f admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.932423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657e138-b0ef-4335-975e-67ecc815fc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.932753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca111-3f8e-48ce-ba54-189013fe0e2b service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:57.934937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657e138-b0ef-4335-975e-67ecc815fc4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.936741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657e138-b0ef-4335-975e-67ecc815fc4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.945528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdebe0e-1c09-4a09-9b0c-5cf0b478fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:57.946785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdebe0e-1c09-4a09-9b0c-5cf0b478fe1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:57.948899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657e138-b0ef-4335-975e-67ecc815fc4f admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:57.954049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdebe0e-1c09-4a09-9b0c-5cf0b478fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:57.954590 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdebe0e-1c09-4a09-9b0c-5cf0b478fe1c admin admin] PATH_INFO: `/v3/users/b8e3c8cad682426db9447cf1e92bfe2f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:57.957096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdebe0e-1c09-4a09-9b0c-5cf0b478fe1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e3c8cad682426db9447cf1e92bfe2f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:57.961646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdebe0e-1c09-4a09-9b0c-5cf0b478fe1c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:58.034527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 966/1918] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:07:57 2022] POST /identity/v3/projects => generated 377 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:58.035437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657e138-b0ef-4335-975e-67ecc815fc4f admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:58.069442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1fdebe0e-1c09-4a09-9b0c-5cf0b478fe1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e3c8cad682426db9447cf1e92bfe2f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:58.070394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1fdebe0e-1c09-4a09-9b0c-5cf0b478fe1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e3c8cad682426db9447cf1e92bfe2f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:58.083147 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1fdebe0e-1c09-4a09-9b0c-5cf0b478fe1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e3c8cad682426db9447cf1e92bfe2f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:58.094320 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1fdebe0e-1c09-4a09-9b0c-5cf0b478fe1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e3c8cad682426db9447cf1e92bfe2f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:58.095241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1fdebe0e-1c09-4a09-9b0c-5cf0b478fe1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e3c8cad682426db9447cf1e92bfe2f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:58.123318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 953/1919] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:57 2022] DELETE /identity/v3/users/b8e3c8cad682426db9447cf1e92bfe2f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:07:58.125853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3bc64-5f61-438e-b872-a443805081c6 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:58.126384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3bc64-5f61-438e-b872-a443805081c6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:58.126813 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3bc64-5f61-438e-b872-a443805081c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:58.150998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:58.163503 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-03f3bc64-5f61-438e-b872-a443805081c6 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:58.167666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-03f3bc64-5f61-438e-b872-a443805081c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:58.175984 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657e138-b0ef-4335-975e-67ecc815fc4f admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:58.216915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:58.257020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 954/1920] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:58.267811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3bc64-5f61-438e-b872-a443805081c6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:58.269498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-03f3bc64-5f61-438e-b872-a443805081c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:58.281064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eaed5-70ce-4af5-b2d0-ff2e4439df35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:58.281867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eaed5-70ce-4af5-b2d0-ff2e4439df35 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:58.282161 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eaed5-70ce-4af5-b2d0-ff2e4439df35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:58.282429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eaed5-70ce-4af5-b2d0-ff2e4439df35 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:58.283280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999eaed5-70ce-4af5-b2d0-ff2e4439df35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:58.285706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999eaed5-70ce-4af5-b2d0-ff2e4439df35 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:58.312073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 967/1921] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:07:58 2022] POST /identity/v3/users => generated 295 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:07:58.313302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eaed5-70ce-4af5-b2d0-ff2e4439df35 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:58.315109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-999eaed5-70ce-4af5-b2d0-ff2e4439df35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:58.328241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eaed5-70ce-4af5-b2d0-ff2e4439df35 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:58.334504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca3967-578d-4bcd-8ce5-c5a101169afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:58.336184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca3967-578d-4bcd-8ce5-c5a101169afe admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:58.337012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca3967-578d-4bcd-8ce5-c5a101169afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:58.337539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca3967-578d-4bcd-8ce5-c5a101169afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:58.339048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3bc64-5f61-438e-b872-a443805081c6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:58.341463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca3967-578d-4bcd-8ce5-c5a101169afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:58.342976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33040b81-fdb2-4afb-9359-9501f3d7a9df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:58.343623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33040b81-fdb2-4afb-9359-9501f3d7a9df service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:58.343903 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33040b81-fdb2-4afb-9359-9501f3d7a9df service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:58.344174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33040b81-fdb2-4afb-9359-9501f3d7a9df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:58.344699 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca3967-578d-4bcd-8ce5-c5a101169afe admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:58.357951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33040b81-fdb2-4afb-9359-9501f3d7a9df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:58.359465 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33040b81-fdb2-4afb-9359-9501f3d7a9df service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:58.360096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 968/1922] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:58.364108 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca3967-578d-4bcd-8ce5-c5a101169afe admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:58.377358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 955/1923] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:07:58.381023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca3967-578d-4bcd-8ce5-c5a101169afe admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:58.386918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c45a7a-7e21-42df-a611-7e51426dd7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:58.388043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45a7a-7e21-42df-a611-7e51426dd7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:58.388497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45a7a-7e21-42df-a611-7e51426dd7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:58.388845 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c45a7a-7e21-42df-a611-7e51426dd7fb admin admin] PATH_INFO: `/v3/projects/5adf975742a04b76911562854c55c8c8/users/f179ce817bfe45a086413d1787931a9a/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:58.404696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c45a7a-7e21-42df-a611-7e51426dd7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adf975742a04b76911562854c55c8c8, user_id=f179ce817bfe45a086413d1787931a9a, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:58.407348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c45a7a-7e21-42df-a611-7e51426dd7fb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:58.422438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 969/1924] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:58 2022] PUT /identity/v3/projects/5adf975742a04b76911562854c55c8c8/users/f179ce817bfe45a086413d1787931a9a/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:58.426441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33040b81-fdb2-4afb-9359-9501f3d7a9df service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:58.437728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33040b81-fdb2-4afb-9359-9501f3d7a9df service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:58.518741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a614be-e406-4d8b-bccf-d7dedeaa36ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:58.519692 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a614be-e406-4d8b-bccf-d7dedeaa36ba admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:58.520136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a614be-e406-4d8b-bccf-d7dedeaa36ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:58.520594 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a614be-e406-4d8b-bccf-d7dedeaa36ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:58.522658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a614be-e406-4d8b-bccf-d7dedeaa36ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:58.525292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a614be-e406-4d8b-bccf-d7dedeaa36ba admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:58.537024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 956/1925] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:07:58.541116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c45a7a-7e21-42df-a611-7e51426dd7fb admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:58.558232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c45a7a-7e21-42df-a611-7e51426dd7fb admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:58.565643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dd48b-92d7-40c6-b2e8-316d916c66d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:58.566582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dd48b-92d7-40c6-b2e8-316d916c66d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:58.566871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dd48b-92d7-40c6-b2e8-316d916c66d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:58.567154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dd48b-92d7-40c6-b2e8-316d916c66d7 admin admin] PATH_INFO: `/v3/projects/5adf975742a04b76911562854c55c8c8/users/f179ce817bfe45a086413d1787931a9a/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:58.569613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dd48b-92d7-40c6-b2e8-316d916c66d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5adf975742a04b76911562854c55c8c8, user_id=f179ce817bfe45a086413d1787931a9a, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:58.572982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dd48b-92d7-40c6-b2e8-316d916c66d7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:58.586673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 970/1926] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:07:58 2022] PUT /identity/v3/projects/5adf975742a04b76911562854c55c8c8/users/f179ce817bfe45a086413d1787931a9a/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:07:58.598053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812cf75-b56f-4538-9cba-37e87664795a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:58.598349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812cf75-b56f-4538-9cba-37e87664795a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:58.598633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812cf75-b56f-4538-9cba-37e87664795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:58.642432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e812cf75-b56f-4538-9cba-37e87664795a None None] MFA Rules not processed for user `f179ce817bfe45a086413d1787931a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:58.643730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e812cf75-b56f-4538-9cba-37e87664795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:58.690489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:58.739850 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 957/1927] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:58.753831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dd48b-92d7-40c6-b2e8-316d916c66d7 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:58.755834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b80dd48b-92d7-40c6-b2e8-316d916c66d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:58.848664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dd48b-92d7-40c6-b2e8-316d916c66d7 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:58.852645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f036f-bc63-4d06-a0b8-56721c356a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:58.853603 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f036f-bc63-4d06-a0b8-56721c356a41 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:58.854083 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f036f-bc63-4d06-a0b8-56721c356a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:58.854422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f036f-bc63-4d06-a0b8-56721c356a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:58.868192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f036f-bc63-4d06-a0b8-56721c356a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:58.869902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f036f-bc63-4d06-a0b8-56721c356a41 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:58.881635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 971/1928] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:58.976208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812cf75-b56f-4538-9cba-37e87664795a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:58.977622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e812cf75-b56f-4538-9cba-37e87664795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.028208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6a393-b673-47fa-88cf-26e08a3976c7 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:59.028711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6a393-b673-47fa-88cf-26e08a3976c7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:59.028876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6a393-b673-47fa-88cf-26e08a3976c7 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:59.030376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 972/1929] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:07:59.038812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c477-508e-44b4-b35f-ae2b04a0a37f None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:59.039181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c477-508e-44b4-b35f-ae2b04a0a37f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:59.039373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35c477-508e-44b4-b35f-ae2b04a0a37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:59.084233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812cf75-b56f-4538-9cba-37e87664795a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:59.096115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-0e35c477-508e-44b4-b35f-ae2b04a0a37f None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:59.098282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:59.099816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0e35c477-508e-44b4-b35f-ae2b04a0a37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.100980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:59.101636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:59.103521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] PATH_INFO: `/v3/projects/1912af67db694b498f1f822a757fcff6` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:59.106409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1912af67db694b498f1f822a757fcff6)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:59.111930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:59.236096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1912af67db694b498f1f822a757fcff6', 'request_id': 'req-830d0832-6368-4d29-a457-21b379f816a0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.249661 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1912af67db694b498f1f822a757fcff6', 'request_id': 'req-830d0832-6368-4d29-a457-21b379f816a0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.261240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:59.267840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1912af67db694b498f1f822a757fcff6', 'request_id': 'req-830d0832-6368-4d29-a457-21b379f816a0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.289570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] The token cache is being invalidate because project 1912af67db694b498f1f822a757fcff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:07:59.289959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.290176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 973/1930] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:07:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:07:59.290825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.297229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 958/1931] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:07:58 2022] DELETE /identity/v3/projects/1912af67db694b498f1f822a757fcff6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:59.302541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a823410-d648-47ce-bf69-14911f21fec1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:59.302835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a823410-d648-47ce-bf69-14911f21fec1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:59.303119 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a823410-d648-47ce-bf69-14911f21fec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:59.347421 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8a823410-d648-47ce-bf69-14911f21fec1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:59.350980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8a823410-d648-47ce-bf69-14911f21fec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.432063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:59.433595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.481990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 974/1932] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:59.483003 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a823410-d648-47ce-bf69-14911f21fec1 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:59.490278 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8a823410-d648-47ce-bf69-14911f21fec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.506248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a823410-d648-47ce-bf69-14911f21fec1 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:59.512000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b3e74-31d8-4985-820d-c3d2e5b304a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:59.513399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3e74-31d8-4985-820d-c3d2e5b304a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:59.513682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3e74-31d8-4985-820d-c3d2e5b304a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:59.513964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b3e74-31d8-4985-820d-c3d2e5b304a5 admin admin] PATH_INFO: `/v3/users/40417167d8f246de8d45552253a02cc1` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:59.515960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b3e74-31d8-4985-820d-c3d2e5b304a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40417167d8f246de8d45552253a02cc1)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:59.518292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b3e74-31d8-4985-820d-c3d2e5b304a5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:59.547957 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d0832-6368-4d29-a457-21b379f816a0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:59.554862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:59.555792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:59.555956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:59.556275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] PATH_INFO: `/v3/users/5296f8bb5e7d4deb8eca56d7abf36c58` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:59.559166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5296f8bb5e7d4deb8eca56d7abf36c58)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:59.562203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:59.566321 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:59.601372 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e77b3e74-31d8-4985-820d-c3d2e5b304a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40417167d8f246de8d45552253a02cc1'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.617366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e77b3e74-31d8-4985-820d-c3d2e5b304a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40417167d8f246de8d45552253a02cc1'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.619019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e77b3e74-31d8-4985-820d-c3d2e5b304a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40417167d8f246de8d45552253a02cc1'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.619910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e77b3e74-31d8-4985-820d-c3d2e5b304a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40417167d8f246de8d45552253a02cc1'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.644152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e77b3e74-31d8-4985-820d-c3d2e5b304a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40417167d8f246de8d45552253a02cc1'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.659570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 975/1933] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:59 2022] DELETE /identity/v3/users/40417167d8f246de8d45552253a02cc1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:59.661212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110e30-22e9-4de4-8a39-0b42d539f8ff None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:59.661574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110e30-22e9-4de4-8a39-0b42d539f8ff None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:59.661929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e110e30-22e9-4de4-8a39-0b42d539f8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:59.670017 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5296f8bb5e7d4deb8eca56d7abf36c58'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.670673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5296f8bb5e7d4deb8eca56d7abf36c58'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.677970 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5296f8bb5e7d4deb8eca56d7abf36c58'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.682875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-0e110e30-22e9-4de4-8a39-0b42d539f8ff None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:59.684632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0e110e30-22e9-4de4-8a39-0b42d539f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.686794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5296f8bb5e7d4deb8eca56d7abf36c58'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.688604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5296f8bb5e7d4deb8eca56d7abf36c58'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:07:59.713278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 959/1934] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:07:59 2022] DELETE /identity/v3/users/5296f8bb5e7d4deb8eca56d7abf36c58 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:07:59.717526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:59.718885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.761335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 976/1935] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:59.763612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f808a-a79a-4d4c-93e6-119e24716284 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:59.763726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f808a-a79a-4d4c-93e6-119e24716284 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:59.764101 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f808a-a79a-4d4c-93e6-119e24716284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:59.787733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-544f808a-a79a-4d4c-93e6-119e24716284 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:59.788998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-544f808a-a79a-4d4c-93e6-119e24716284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.798160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:07:59.841712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aee4ca-46bf-41d1-bd0d-d44eae060577 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:59.850032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3fce1-b9c9-4fe7-b9fd-e68c55fb8777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:59.850693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3fce1-b9c9-4fe7-b9fd-e68c55fb8777 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:59.851216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3fce1-b9c9-4fe7-b9fd-e68c55fb8777 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:59.851502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3fce1-b9c9-4fe7-b9fd-e68c55fb8777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:59.854211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0fa3fce1-b9c9-4fe7-b9fd-e68c55fb8777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.861427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 977/1936] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:59.862747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dc373-552f-47a4-b892-b1ead6a63209 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:59.863045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dc373-552f-47a4-b892-b1ead6a63209 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:59.863351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dc373-552f-47a4-b892-b1ead6a63209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:59.882081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-ea1dc373-552f-47a4-b892-b1ead6a63209 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:07:59.883223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ea1dc373-552f-47a4-b892-b1ead6a63209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.889434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3fce1-b9c9-4fe7-b9fd-e68c55fb8777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:59.895173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 978/1937] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:07:59.895173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dc373-552f-47a4-b892-b1ead6a63209 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:59.897320 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3fce1-b9c9-4fe7-b9fd-e68c55fb8777 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:59.913568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 960/1938] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:07:59.914160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dc373-552f-47a4-b892-b1ead6a63209 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:59.914564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3fce1-b9c9-4fe7-b9fd-e68c55fb8777 service nova] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:59.916393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0fa3fce1-b9c9-4fe7-b9fd-e68c55fb8777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.921020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54350b2b-35b2-43ad-9caf-de58e79ddaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:59.922141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54350b2b-35b2-43ad-9caf-de58e79ddaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:07:59.922897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54350b2b-35b2-43ad-9caf-de58e79ddaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:07:59.923528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54350b2b-35b2-43ad-9caf-de58e79ddaa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:07:59.924454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54350b2b-35b2-43ad-9caf-de58e79ddaa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:07:59.925031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54350b2b-35b2-43ad-9caf-de58e79ddaa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:07:59.927235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54350b2b-35b2-43ad-9caf-de58e79ddaa7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:07:59.944748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 979/1939] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:07:59.944748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54350b2b-35b2-43ad-9caf-de58e79ddaa7 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:07:59.952891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-54350b2b-35b2-43ad-9caf-de58e79ddaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:07:59.994211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3fce1-b9c9-4fe7-b9fd-e68c55fb8777 service nova] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:07:59.998793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31a13-04bd-4c61-aa0b-6c85df4c9586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:07:59.999816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31a13-04bd-4c61-aa0b-6c85df4c9586 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:00.000158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31a13-04bd-4c61-aa0b-6c85df4c9586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:00.000481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31a13-04bd-4c61-aa0b-6c85df4c9586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:00.012665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f31a13-04bd-4c61-aa0b-6c85df4c9586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:00.016440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f31a13-04bd-4c61-aa0b-6c85df4c9586 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:00.030684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54350b2b-35b2-43ad-9caf-de58e79ddaa7 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:00.032053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 961/1940] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:00.035154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a6939-dada-4b27-a253-1590b6317131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:00.035805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6939-dada-4b27-a253-1590b6317131 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:00.036098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6939-dada-4b27-a253-1590b6317131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:00.036419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a6939-dada-4b27-a253-1590b6317131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:00.044356 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31a13-04bd-4c61-aa0b-6c85df4c9586 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:00.047293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a6939-dada-4b27-a253-1590b6317131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:00.049884 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a6939-dada-4b27-a253-1590b6317131 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:00.055590 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31a13-04bd-4c61-aa0b-6c85df4c9586 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:00.062301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168911b-8882-4426-8e32-53ceda75c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:00.062957 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168911b-8882-4426-8e32-53ceda75c398 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:00.063287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168911b-8882-4426-8e32-53ceda75c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:00.063547 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168911b-8882-4426-8e32-53ceda75c398 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:00.064249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168911b-8882-4426-8e32-53ceda75c398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:00.066504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 980/1941] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:00.066671 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168911b-8882-4426-8e32-53ceda75c398 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:00.071751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:00.102451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 962/1942] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:00 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:00.103832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a6939-dada-4b27-a253-1590b6317131 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:00.116763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a6939-dada-4b27-a253-1590b6317131 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:00.188998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef953e55-a35a-44b1-8681-64ff2c179e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:00.189669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef953e55-a35a-44b1-8681-64ff2c179e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:00.189953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef953e55-a35a-44b1-8681-64ff2c179e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:00.190225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef953e55-a35a-44b1-8681-64ff2c179e1d admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:00.191061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef953e55-a35a-44b1-8681-64ff2c179e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:00.193604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef953e55-a35a-44b1-8681-64ff2c179e1d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:00.216006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 981/1943] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:00 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:00.219940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168911b-8882-4426-8e32-53ceda75c398 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:00.243139 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168911b-8882-4426-8e32-53ceda75c398 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:00.260176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93259f-f15f-4c84-bbf1-7feb27ab54a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:00.260652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93259f-f15f-4c84-bbf1-7feb27ab54a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:00.261043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93259f-f15f-4c84-bbf1-7feb27ab54a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:00.261531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93259f-f15f-4c84-bbf1-7feb27ab54a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:00.262358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93259f-f15f-4c84-bbf1-7feb27ab54a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:00.264094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93259f-f15f-4c84-bbf1-7feb27ab54a1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:00.282170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 963/1944] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:00.283051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef953e55-a35a-44b1-8681-64ff2c179e1d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:00.296606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef953e55-a35a-44b1-8681-64ff2c179e1d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:00.304938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d04b7-008c-4ab8-b8a8-3e5d972d3f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:00.305844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d04b7-008c-4ab8-b8a8-3e5d972d3f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:00.306330 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d04b7-008c-4ab8-b8a8-3e5d972d3f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:00.306631 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d04b7-008c-4ab8-b8a8-3e5d972d3f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:00.307397 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d04b7-008c-4ab8-b8a8-3e5d972d3f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:00.311388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d04b7-008c-4ab8-b8a8-3e5d972d3f82 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:00.327385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93259f-f15f-4c84-bbf1-7feb27ab54a1 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:00.328514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 982/1945] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:08:00.338240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93259f-f15f-4c84-bbf1-7feb27ab54a1 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:00.344390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f3e4-5a50-4a11-beb7-d4ba34f16277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:00.345702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f3e4-5a50-4a11-beb7-d4ba34f16277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:00.346013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f3e4-5a50-4a11-beb7-d4ba34f16277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:00.346260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f3e4-5a50-4a11-beb7-d4ba34f16277 admin admin] PATH_INFO: `/v3/projects/b397fe0cfde44535b2de63ae69fdf3da/users/2525ac7476134b47956db1c6f5719498/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:00.366916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f3e4-5a50-4a11-beb7-d4ba34f16277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b397fe0cfde44535b2de63ae69fdf3da, user_id=2525ac7476134b47956db1c6f5719498, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:00.370690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f3e4-5a50-4a11-beb7-d4ba34f16277 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:00.385864 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 964/1946] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:00 2022] PUT /identity/v3/projects/b397fe0cfde44535b2de63ae69fdf3da/users/2525ac7476134b47956db1c6f5719498/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:00.390985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9379b70-14db-4f68-9479-d966319c8ec8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:00.391338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9379b70-14db-4f68-9479-d966319c8ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:00.391626 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9379b70-14db-4f68-9479-d966319c8ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:00.411585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d9379b70-14db-4f68-9479-d966319c8ec8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:00.412813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d9379b70-14db-4f68-9479-d966319c8ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:00.424478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:00.486277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 983/1947] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:00.517545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f3e4-5a50-4a11-beb7-d4ba34f16277 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:00.598363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f3e4-5a50-4a11-beb7-d4ba34f16277 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:00.606033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b5b60-edde-417f-9af1-4e542c6a7d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:00.607014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b5b60-edde-417f-9af1-4e542c6a7d89 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:00.607495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b5b60-edde-417f-9af1-4e542c6a7d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:00.607979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b5b60-edde-417f-9af1-4e542c6a7d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:00.626094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b5b60-edde-417f-9af1-4e542c6a7d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:00.630172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b5b60-edde-417f-9af1-4e542c6a7d89 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:00.641980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 965/1948] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:00.758302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9379b70-14db-4f68-9479-d966319c8ec8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:00.763041 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d9379b70-14db-4f68-9479-d966319c8ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:00.804618 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9379b70-14db-4f68-9479-d966319c8ec8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:00.832062 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:00.835446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:00.835446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:00.835446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] PATH_INFO: `/v3/projects/f32e5760b29743809f9a70eedebe2ded` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:00.836994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b5b60-edde-417f-9af1-4e542c6a7d89 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:00.837988 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32e5760b29743809f9a70eedebe2ded)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:00.839130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ca1b5b60-edde-417f-9af1-4e542c6a7d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:00.840593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:00.875574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b5b60-edde-417f-9af1-4e542c6a7d89 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:00.888266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:00.889172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:00.889626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:00.889761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] PATH_INFO: `/v3/projects/945bc6396a004e77a68fa5344d534967` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:00.897221 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945bc6396a004e77a68fa5344d534967)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:00.899328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:00.993638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32e5760b29743809f9a70eedebe2ded', 'request_id': 'req-985c9a66-7550-421a-9137-23c0a44ed2e5'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.009217 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32e5760b29743809f9a70eedebe2ded', 'request_id': 'req-985c9a66-7550-421a-9137-23c0a44ed2e5'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.036875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32e5760b29743809f9a70eedebe2ded', 'request_id': 'req-985c9a66-7550-421a-9137-23c0a44ed2e5'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.060794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] The token cache is being invalidate because project f32e5760b29743809f9a70eedebe2ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:01.061523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.063914 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945bc6396a004e77a68fa5344d534967', 'request_id': 'req-ee52915d-e53e-4d6d-b124-577cca82d7d3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.065467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.067822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 984/1949] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:00 2022] DELETE /identity/v3/projects/f32e5760b29743809f9a70eedebe2ded => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:01.072791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:01.076756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:01.077574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945bc6396a004e77a68fa5344d534967', 'request_id': 'req-ee52915d-e53e-4d6d-b124-577cca82d7d3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.093998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945bc6396a004e77a68fa5344d534967', 'request_id': 'req-ee52915d-e53e-4d6d-b124-577cca82d7d3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.117274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] The token cache is being invalidate because project 945bc6396a004e77a68fa5344d534967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:01.117568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.119119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.125787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 966/1950] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:00 2022] DELETE /identity/v3/projects/945bc6396a004e77a68fa5344d534967 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:01.130672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:01.132240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:01.180959 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c9a66-7550-421a-9137-23c0a44ed2e5 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:01.229620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:01.262331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:01.280642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52915d-e53e-4d6d-b124-577cca82d7d3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:01.305661 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e268d68-124a-47a0-a3ba-4dc6bba896e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:01.306559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e268d68-124a-47a0-a3ba-4dc6bba896e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:01.307016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e268d68-124a-47a0-a3ba-4dc6bba896e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:01.307303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e268d68-124a-47a0-a3ba-4dc6bba896e9 admin admin] PATH_INFO: `/v3/users/f179ce817bfe45a086413d1787931a9a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:01.309313 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e268d68-124a-47a0-a3ba-4dc6bba896e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f179ce817bfe45a086413d1787931a9a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:01.311272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e268d68-124a-47a0-a3ba-4dc6bba896e9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:01.314917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:01.317153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:01.318119 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:01.319137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] PATH_INFO: `/v3/users/f6e4e5aad96b422b9f563dc735d6030a` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:01.322155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e4e5aad96b422b9f563dc735d6030a)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:01.330117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:01.404214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7e268d68-124a-47a0-a3ba-4dc6bba896e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f179ce817bfe45a086413d1787931a9a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.406130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7e268d68-124a-47a0-a3ba-4dc6bba896e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f179ce817bfe45a086413d1787931a9a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.413365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e4e5aad96b422b9f563dc735d6030a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.419622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7e268d68-124a-47a0-a3ba-4dc6bba896e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f179ce817bfe45a086413d1787931a9a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.425837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e4e5aad96b422b9f563dc735d6030a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.428550 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e4e5aad96b422b9f563dc735d6030a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.429760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e4e5aad96b422b9f563dc735d6030a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.436739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7e268d68-124a-47a0-a3ba-4dc6bba896e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f179ce817bfe45a086413d1787931a9a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.437736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7e268d68-124a-47a0-a3ba-4dc6bba896e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f179ce817bfe45a086413d1787931a9a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.463770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e4e5aad96b422b9f563dc735d6030a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:01.487717 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 967/1951] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:01 2022] DELETE /identity/v3/users/f179ce817bfe45a086413d1787931a9a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:01.489756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 985/1952] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:01 2022] DELETE /identity/v3/users/f6e4e5aad96b422b9f563dc735d6030a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:01.978066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e894-e9d3-440c-aa3b-9e1e2f170891 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:01.978354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e894-e9d3-440c-aa3b-9e1e2f170891 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:01.978626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e894-e9d3-440c-aa3b-9e1e2f170891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.032690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:02.035735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:02.043472 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0196e894-e9d3-440c-aa3b-9e1e2f170891 None None] MFA Rules not processed for user `2525ac7476134b47956db1c6f5719498`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:02.047584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0196e894-e9d3-440c-aa3b-9e1e2f170891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:02.199502 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0146ad-7060-4590-8ede-39431ed60a9e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:02.211008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:02.211904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.212188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.212492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] PATH_INFO: `/v3/projects/0df50f28ae6940ec909c7a7563b4dafc` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.214428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df50f28ae6940ec909c7a7563b4dafc)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:02.217508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:02.230651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 968/1953] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:02.231817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e894-e9d3-440c-aa3b-9e1e2f170891 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:02.234325 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0196e894-e9d3-440c-aa3b-9e1e2f170891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:02.273354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e894-e9d3-440c-aa3b-9e1e2f170891 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:02.286375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:02.287643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.287643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.287837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] PATH_INFO: `/v3/projects/5adf975742a04b76911562854c55c8c8` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.289076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5adf975742a04b76911562854c55c8c8)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:02.290998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:02.346743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df50f28ae6940ec909c7a7563b4dafc', 'request_id': 'req-4e437af9-9de1-41ad-9f54-c23d73095bd0'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:02.350304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:02.359980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df50f28ae6940ec909c7a7563b4dafc', 'request_id': 'req-4e437af9-9de1-41ad-9f54-c23d73095bd0'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:02.360232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5adf975742a04b76911562854c55c8c8', 'request_id': 'req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:02.371374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5adf975742a04b76911562854c55c8c8', 'request_id': 'req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:02.381173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5adf975742a04b76911562854c55c8c8', 'request_id': 'req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:02.393094 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df50f28ae6940ec909c7a7563b4dafc', 'request_id': 'req-4e437af9-9de1-41ad-9f54-c23d73095bd0'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:02.396084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] The token cache is being invalidate because project 5adf975742a04b76911562854c55c8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:02.397255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:02.398514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:02.399385 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:02.400645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 969/1954] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:02 2022] DELETE /identity/v3/projects/5adf975742a04b76911562854c55c8c8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:02.401655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:02.403244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:02.428615 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] The token cache is being invalidate because project 0df50f28ae6940ec909c7a7563b4dafc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:02.429059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:02.431847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-4e437af9-9de1-41ad-9f54-c23d73095bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:02.434239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 986/1955] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:02 2022] DELETE /identity/v3/projects/0df50f28ae6940ec909c7a7563b4dafc => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:02.435425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68288a3-4ba5-48d0-925f-7319ca101e54 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.435814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68288a3-4ba5-48d0-925f-7319ca101e54 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.436219 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68288a3-4ba5-48d0-925f-7319ca101e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.467443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a68288a3-4ba5-48d0-925f-7319ca101e54 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:02.468825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a68288a3-4ba5-48d0-925f-7319ca101e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:02.491667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afaaf2-3fd3-4829-a140-1c5f44e8ceb8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:02.501385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a0668-9b64-4ce7-86b2-1855ff3a970a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:02.502050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0668-9b64-4ce7-86b2-1855ff3a970a service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.502327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0668-9b64-4ce7-86b2-1855ff3a970a service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.502598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a0668-9b64-4ce7-86b2-1855ff3a970a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.504449 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d47a0668-9b64-4ce7-86b2-1855ff3a970a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:02.537572 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 987/1956] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:02.537572 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93e11-e06e-4cab-a4fc-c1069b844a2e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.537572 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93e11-e06e-4cab-a4fc-c1069b844a2e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.537572 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93e11-e06e-4cab-a4fc-c1069b844a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.561058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b0b93e11-e06e-4cab-a4fc-c1069b844a2e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:02.562584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b0b93e11-e06e-4cab-a4fc-c1069b844a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:02.574588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 988/1957] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:02.575890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e34927-83d8-41b8-a476-e6864d7102f1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.576181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e34927-83d8-41b8-a476-e6864d7102f1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.576563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e34927-83d8-41b8-a476-e6864d7102f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.584301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a0668-9b64-4ce7-86b2-1855ff3a970a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:02.585788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a0668-9b64-4ce7-86b2-1855ff3a970a service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:02.596787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 970/1958] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:02.601407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c9e34927-83d8-41b8-a476-e6864d7102f1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:02.602611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d49eb-4d5d-476b-92d0-b85f831ae5ed None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.602736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c9e34927-83d8-41b8-a476-e6864d7102f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:02.604570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d49eb-4d5d-476b-92d0-b85f831ae5ed None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.605081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d49eb-4d5d-476b-92d0-b85f831ae5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.612699 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 989/1959] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:02.626450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e34927-83d8-41b8-a476-e6864d7102f1 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:02.636980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e34927-83d8-41b8-a476-e6864d7102f1 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:02.640812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a19d49eb-4d5d-476b-92d0-b85f831ae5ed None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:02.642155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a19d49eb-4d5d-476b-92d0-b85f831ae5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:02.644707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2983797-69c6-4fcb-87bb-c6ec968c9884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:02.645413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2983797-69c6-4fcb-87bb-c6ec968c9884 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.645959 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2983797-69c6-4fcb-87bb-c6ec968c9884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.646235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2983797-69c6-4fcb-87bb-c6ec968c9884 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.647004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2983797-69c6-4fcb-87bb-c6ec968c9884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:02.647274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2983797-69c6-4fcb-87bb-c6ec968c9884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:02.649435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2983797-69c6-4fcb-87bb-c6ec968c9884 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:02.663419 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 971/1960] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:02.665050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d49eb-4d5d-476b-92d0-b85f831ae5ed None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:02.679938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 990/1961] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:02.684993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2983797-69c6-4fcb-87bb-c6ec968c9884 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:02.693481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d49eb-4d5d-476b-92d0-b85f831ae5ed None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:02.708878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2983797-69c6-4fcb-87bb-c6ec968c9884 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:02.709316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b83a9-820f-41b4-8e59-83bebd5dbd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:02.710107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b83a9-820f-41b4-8e59-83bebd5dbd06 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.710296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b83a9-820f-41b4-8e59-83bebd5dbd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.710569 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b83a9-820f-41b4-8e59-83bebd5dbd06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.711313 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b83a9-820f-41b4-8e59-83bebd5dbd06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:02.711624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b83a9-820f-41b4-8e59-83bebd5dbd06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:02.713273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b83a9-820f-41b4-8e59-83bebd5dbd06 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:02.715955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c949598-f448-4933-a836-cbf03b439965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:02.718426 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949598-f448-4933-a836-cbf03b439965 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.719026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949598-f448-4933-a836-cbf03b439965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.719826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949598-f448-4933-a836-cbf03b439965 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.720822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c949598-f448-4933-a836-cbf03b439965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:02.727583 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c949598-f448-4933-a836-cbf03b439965 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:02.739578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 972/1962] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:02.740880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b83a9-820f-41b4-8e59-83bebd5dbd06 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:02.764222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b83a9-820f-41b4-8e59-83bebd5dbd06 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:02.778834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ccd9-650a-4873-a541-640443d41281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:02.779511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ccd9-650a-4873-a541-640443d41281 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.779799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ccd9-650a-4873-a541-640443d41281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.780080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ccd9-650a-4873-a541-640443d41281 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.780814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3ccd9-650a-4873-a541-640443d41281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:02.782732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3ccd9-650a-4873-a541-640443d41281 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:02.788595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 991/1963] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:02 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:02.790085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c949598-f448-4933-a836-cbf03b439965 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:02.845065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 973/1964] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:02 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:02.850284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ccd9-650a-4873-a541-640443d41281 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:02.880341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c949598-f448-4933-a836-cbf03b439965 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:02.950611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:02.965138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:02.976948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c9e0b-fa29-49b1-bdcf-d03ab79fcccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:02.977650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9e0b-fa29-49b1-bdcf-d03ab79fcccd admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:02.977986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9e0b-fa29-49b1-bdcf-d03ab79fcccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:02.978326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c9e0b-fa29-49b1-bdcf-d03ab79fcccd admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:02.979116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c9e0b-fa29-49b1-bdcf-d03ab79fcccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:02.988601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c9e0b-fa29-49b1-bdcf-d03ab79fcccd admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:02.995469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ccd9-650a-4873-a541-640443d41281 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.013361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c039d3-7e1b-448b-8f20-9b2478eecdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.016700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c039d3-7e1b-448b-8f20-9b2478eecdea admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.017086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c039d3-7e1b-448b-8f20-9b2478eecdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.017415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c039d3-7e1b-448b-8f20-9b2478eecdea admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.026305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c039d3-7e1b-448b-8f20-9b2478eecdea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.026305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c039d3-7e1b-448b-8f20-9b2478eecdea admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.054576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 992/1965] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:02 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:03.057198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c9e0b-fa29-49b1-bdcf-d03ab79fcccd admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.082879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 974/1966] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:02 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:08:03.085772 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c039d3-7e1b-448b-8f20-9b2478eecdea admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.098797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c9e0b-fa29-49b1-bdcf-d03ab79fcccd admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.104704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb52747-ea7c-489c-9551-9759a2075c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.105795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52747-ea7c-489c-9551-9759a2075c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.106088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52747-ea7c-489c-9551-9759a2075c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.106369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52747-ea7c-489c-9551-9759a2075c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.107114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb52747-ea7c-489c-9551-9759a2075c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.110641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb52747-ea7c-489c-9551-9759a2075c69 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.112728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c039d3-7e1b-448b-8f20-9b2478eecdea admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.119142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87574528-1ef9-45bd-9d1c-3ebc97b63aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.120067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574528-1ef9-45bd-9d1c-3ebc97b63aaf admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.120579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574528-1ef9-45bd-9d1c-3ebc97b63aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.121146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87574528-1ef9-45bd-9d1c-3ebc97b63aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.122102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87574528-1ef9-45bd-9d1c-3ebc97b63aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.122222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 993/1967] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:03.124405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87574528-1ef9-45bd-9d1c-3ebc97b63aaf admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.131018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb52747-ea7c-489c-9551-9759a2075c69 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.144414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 975/1968] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:03.145575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb52747-ea7c-489c-9551-9759a2075c69 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.145960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87574528-1ef9-45bd-9d1c-3ebc97b63aaf admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.151621 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8eeac-6d95-490e-b7ef-f09275f819eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.152622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8eeac-6d95-490e-b7ef-f09275f819eb admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.152916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8eeac-6d95-490e-b7ef-f09275f819eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.153334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8eeac-6d95-490e-b7ef-f09275f819eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.154382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8eeac-6d95-490e-b7ef-f09275f819eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.157543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8eeac-6d95-490e-b7ef-f09275f819eb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.160907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87574528-1ef9-45bd-9d1c-3ebc97b63aaf admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.166441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c40d-ac21-4242-a012-3b9d92fdd18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.167208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c40d-ac21-4242-a012-3b9d92fdd18d admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.167818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c40d-ac21-4242-a012-3b9d92fdd18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.168146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c40d-ac21-4242-a012-3b9d92fdd18d admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.169094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c40d-ac21-4242-a012-3b9d92fdd18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.171084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c40d-ac21-4242-a012-3b9d92fdd18d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.172589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 994/1969] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:08:03.176554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8eeac-6d95-490e-b7ef-f09275f819eb admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.191054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 976/1970] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:03.192925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8eeac-6d95-490e-b7ef-f09275f819eb admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.195666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c40d-ac21-4242-a012-3b9d92fdd18d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.200852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724756d1-2195-4180-99c7-3a6e12c9459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.202297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724756d1-2195-4180-99c7-3a6e12c9459d admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.202725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724756d1-2195-4180-99c7-3a6e12c9459d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.203076 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724756d1-2195-4180-99c7-3a6e12c9459d admin admin] PATH_INFO: `/v3/projects/47bd44d0c5e84df7a8b641fcc654ec8d/users/45ef0155b126440ab06031a02f354f10/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.207841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c40d-ac21-4242-a012-3b9d92fdd18d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.212761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471da52d-3d80-4cc8-8ff5-52c526314f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.213632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da52d-3d80-4cc8-8ff5-52c526314f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.213914 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da52d-3d80-4cc8-8ff5-52c526314f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.215283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da52d-3d80-4cc8-8ff5-52c526314f26 admin admin] PATH_INFO: `/v3/projects/d534f62f30774ed2ae1f7ead1b20f822/users/e406fb4de0f74824a104965164aaef33/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.221595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724756d1-2195-4180-99c7-3a6e12c9459d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47bd44d0c5e84df7a8b641fcc654ec8d, user_id=45ef0155b126440ab06031a02f354f10, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.224867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724756d1-2195-4180-99c7-3a6e12c9459d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.233899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471da52d-3d80-4cc8-8ff5-52c526314f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d534f62f30774ed2ae1f7ead1b20f822, user_id=e406fb4de0f74824a104965164aaef33, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.236744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471da52d-3d80-4cc8-8ff5-52c526314f26 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.244700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 995/1971] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:03 2022] PUT /identity/v3/projects/47bd44d0c5e84df7a8b641fcc654ec8d/users/45ef0155b126440ab06031a02f354f10/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:03.257031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad943e1d-0731-4a0e-847f-adad678db1ab None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.257601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad943e1d-0731-4a0e-847f-adad678db1ab None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.257891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad943e1d-0731-4a0e-847f-adad678db1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.272370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 977/1972] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:03 2022] PUT /identity/v3/projects/d534f62f30774ed2ae1f7ead1b20f822/users/e406fb4de0f74824a104965164aaef33/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:03.278875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4236c-f722-4020-9d09-8336ac4bd6d2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.279164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4236c-f722-4020-9d09-8336ac4bd6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.279437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4236c-f722-4020-9d09-8336ac4bd6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.289462 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-ad943e1d-0731-4a0e-847f-adad678db1ab None None] MFA Rules not processed for user `45ef0155b126440ab06031a02f354f10`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:03.290804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ad943e1d-0731-4a0e-847f-adad678db1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:03.312969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-78f4236c-f722-4020-9d09-8336ac4bd6d2 None None] MFA Rules not processed for user `e406fb4de0f74824a104965164aaef33`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:03.314409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-78f4236c-f722-4020-9d09-8336ac4bd6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:03.392460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 996/1973] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:03.405287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad943e1d-0731-4a0e-847f-adad678db1ab None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.406748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ad943e1d-0731-4a0e-847f-adad678db1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:03.420356 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 978/1974] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:03.424244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4236c-f722-4020-9d09-8336ac4bd6d2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.480607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad943e1d-0731-4a0e-847f-adad678db1ab None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.486650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3652-57ce-455d-a6f7-beaf11177818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.487312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3652-57ce-455d-a6f7-beaf11177818 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.487596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3652-57ce-455d-a6f7-beaf11177818 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.487875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e3652-57ce-455d-a6f7-beaf11177818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.491424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4236c-f722-4020-9d09-8336ac4bd6d2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.497449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e3652-57ce-455d-a6f7-beaf11177818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.498894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e3652-57ce-455d-a6f7-beaf11177818 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.501545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57995d-3357-482c-b21d-fed68537f2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.502773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57995d-3357-482c-b21d-fed68537f2ca admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.503056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57995d-3357-482c-b21d-fed68537f2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.503443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57995d-3357-482c-b21d-fed68537f2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.504443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57995d-3357-482c-b21d-fed68537f2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.506318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57995d-3357-482c-b21d-fed68537f2ca admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.513155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 997/1975] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:08:03.531407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3652-57ce-455d-a6f7-beaf11177818 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.541086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:03.544771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e3652-57ce-455d-a6f7-beaf11177818 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.550827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 979/1976] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:03 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:03.553034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f153f4-2c86-4b8a-a3f1-5fdc0030002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.554263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57995d-3357-482c-b21d-fed68537f2ca admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.555425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f153f4-2c86-4b8a-a3f1-5fdc0030002b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.555717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f153f4-2c86-4b8a-a3f1-5fdc0030002b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.555996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f153f4-2c86-4b8a-a3f1-5fdc0030002b admin admin] PATH_INFO: `/v3/users/45ef0155b126440ab06031a02f354f10` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.557741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f153f4-2c86-4b8a-a3f1-5fdc0030002b admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ef0155b126440ab06031a02f354f10)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.561374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f153f4-2c86-4b8a-a3f1-5fdc0030002b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.594444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:03.619758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-44f153f4-2c86-4b8a-a3f1-5fdc0030002b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ef0155b126440ab06031a02f354f10'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:03.629939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-44f153f4-2c86-4b8a-a3f1-5fdc0030002b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ef0155b126440ab06031a02f354f10'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:03.630970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-44f153f4-2c86-4b8a-a3f1-5fdc0030002b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ef0155b126440ab06031a02f354f10'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:03.631619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-44f153f4-2c86-4b8a-a3f1-5fdc0030002b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ef0155b126440ab06031a02f354f10'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:03.647352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-44f153f4-2c86-4b8a-a3f1-5fdc0030002b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ef0155b126440ab06031a02f354f10'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:03.648421 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57995d-3357-482c-b21d-fed68537f2ca admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.658746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fc55d-0eb3-40b2-8106-b5247b0de8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.660437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc55d-0eb3-40b2-8106-b5247b0de8be admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.660726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc55d-0eb3-40b2-8106-b5247b0de8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.661003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fc55d-0eb3-40b2-8106-b5247b0de8be admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.661989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fc55d-0eb3-40b2-8106-b5247b0de8be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.663922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fc55d-0eb3-40b2-8106-b5247b0de8be admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.666919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 998/1977] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:03 2022] DELETE /identity/v3/users/45ef0155b126440ab06031a02f354f10 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:03.668500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a3da5-4c0c-4c61-84b9-6f65222fe40d None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.668913 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a3da5-4c0c-4c61-84b9-6f65222fe40d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.669322 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a3da5-4c0c-4c61-84b9-6f65222fe40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.696485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 980/1978] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:03 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:08:03.701275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fc55d-0eb3-40b2-8106-b5247b0de8be admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.703262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c93fc55d-0eb3-40b2-8106-b5247b0de8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:03.714008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-686a3da5-4c0c-4c61-84b9-6f65222fe40d None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:03.716163 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-686a3da5-4c0c-4c61-84b9-6f65222fe40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:03.721487 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fc55d-0eb3-40b2-8106-b5247b0de8be admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.847453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c04ef-fb3c-422b-a1aa-e9fe16ec95ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.848538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c04ef-fb3c-422b-a1aa-e9fe16ec95ba admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.848830 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c04ef-fb3c-422b-a1aa-e9fe16ec95ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.849274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c04ef-fb3c-422b-a1aa-e9fe16ec95ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.850041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c04ef-fb3c-422b-a1aa-e9fe16ec95ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.852100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c04ef-fb3c-422b-a1aa-e9fe16ec95ba admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.856468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 999/1979] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:03.869607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a3da5-4c0c-4c61-84b9-6f65222fe40d None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.874100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 981/1980] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:03.874255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-686a3da5-4c0c-4c61-84b9-6f65222fe40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:03.875236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c04ef-fb3c-422b-a1aa-e9fe16ec95ba admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.898046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c04ef-fb3c-422b-a1aa-e9fe16ec95ba admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:03.908693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24e141-2fe3-494c-930f-126136c10406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:03.910765 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24e141-2fe3-494c-930f-126136c10406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:03.911053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24e141-2fe3-494c-930f-126136c10406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:03.911328 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24e141-2fe3-494c-930f-126136c10406 admin admin] PATH_INFO: `/v3/projects/a5ddbb734ff54a529b8dc1df80595ec2/users/609fcbe1b30e4199b66f7f36d9cfb94e/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:03.945409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24e141-2fe3-494c-930f-126136c10406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ddbb734ff54a529b8dc1df80595ec2, user_id=609fcbe1b30e4199b66f7f36d9cfb94e, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:03.948421 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24e141-2fe3-494c-930f-126136c10406 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:03.964195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 982/1981] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:03 2022] PUT /identity/v3/projects/a5ddbb734ff54a529b8dc1df80595ec2/users/609fcbe1b30e4199b66f7f36d9cfb94e/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:03.968373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24e141-2fe3-494c-930f-126136c10406 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:03.969573 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a3da5-4c0c-4c61-84b9-6f65222fe40d None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:04.036612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a4406-a19a-4c27-aecd-6eb0f9c68310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:04.037501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a4406-a19a-4c27-aecd-6eb0f9c68310 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.037992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a4406-a19a-4c27-aecd-6eb0f9c68310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.038493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a4406-a19a-4c27-aecd-6eb0f9c68310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.039332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24e141-2fe3-494c-930f-126136c10406 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:04.045446 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0be3a9-3fec-42fe-86dc-0c5ea1d4f611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:04.046139 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be3a9-3fec-42fe-86dc-0c5ea1d4f611 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.046423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be3a9-3fec-42fe-86dc-0c5ea1d4f611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.046703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0be3a9-3fec-42fe-86dc-0c5ea1d4f611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.048512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0be3a9-3fec-42fe-86dc-0c5ea1d4f611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:04.050447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a4406-a19a-4c27-aecd-6eb0f9c68310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:04.052014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a4406-a19a-4c27-aecd-6eb0f9c68310 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:04.052558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0be3a9-3fec-42fe-86dc-0c5ea1d4f611 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:04.056532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:04.063547 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1000/1982] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:08:04.073596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 983/1983] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:08:04.075013 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a4406-a19a-4c27-aecd-6eb0f9c68310 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:04.080511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:04.086111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a4406-a19a-4c27-aecd-6eb0f9c68310 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:04.093301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb286e33-0ada-4bb3-b5ea-4c44aa627358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:04.094714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286e33-0ada-4bb3-b5ea-4c44aa627358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.095082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286e33-0ada-4bb3-b5ea-4c44aa627358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.095726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286e33-0ada-4bb3-b5ea-4c44aa627358 admin admin] PATH_INFO: `/v3/projects/a5ddbb734ff54a529b8dc1df80595ec2/users/609fcbe1b30e4199b66f7f36d9cfb94e/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.103856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb286e33-0ada-4bb3-b5ea-4c44aa627358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ddbb734ff54a529b8dc1df80595ec2, user_id=609fcbe1b30e4199b66f7f36d9cfb94e, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:04.109426 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb286e33-0ada-4bb3-b5ea-4c44aa627358 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:04.124428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1001/1984] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:04 2022] PUT /identity/v3/projects/a5ddbb734ff54a529b8dc1df80595ec2/users/609fcbe1b30e4199b66f7f36d9cfb94e/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:04.134932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62001b-3cf2-4d00-aa5f-562458059f00 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.135320 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62001b-3cf2-4d00-aa5f-562458059f00 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.135881 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62001b-3cf2-4d00-aa5f-562458059f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.177997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fb62001b-3cf2-4d00-aa5f-562458059f00 None None] MFA Rules not processed for user `609fcbe1b30e4199b66f7f36d9cfb94e`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:04.179933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fb62001b-3cf2-4d00-aa5f-562458059f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:04.202086 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527c900-b1c6-4af2-aa1d-291c98bedbad None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.202587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527c900-b1c6-4af2-aa1d-291c98bedbad None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.202732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527c900-b1c6-4af2-aa1d-291c98bedbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.222783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4527c900-b1c6-4af2-aa1d-291c98bedbad None None] MFA Rules not processed for user `2525ac7476134b47956db1c6f5719498`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:04.224021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4527c900-b1c6-4af2-aa1d-291c98bedbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:04.354677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1002/1985] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:04.385641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 984/1986] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:04.398408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527c900-b1c6-4af2-aa1d-291c98bedbad None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:04.399924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4527c900-b1c6-4af2-aa1d-291c98bedbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:04.475412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527c900-b1c6-4af2-aa1d-291c98bedbad None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:04.479845 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b59a3a-72ac-439e-80dd-92030fa59fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:04.481229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b59a3a-72ac-439e-80dd-92030fa59fab service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.481519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b59a3a-72ac-439e-80dd-92030fa59fab service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.481918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b59a3a-72ac-439e-80dd-92030fa59fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.490195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62001b-3cf2-4d00-aa5f-562458059f00 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:04.492016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fb62001b-3cf2-4d00-aa5f-562458059f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:04.510581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b59a3a-72ac-439e-80dd-92030fa59fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:04.512486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b59a3a-72ac-439e-80dd-92030fa59fab service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:04.527272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1003/1987] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:08:04.584512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62001b-3cf2-4d00-aa5f-562458059f00 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:04.595056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:04.595599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b59a3a-72ac-439e-80dd-92030fa59fab service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:04.596706 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.596997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.597282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] PATH_INFO: `/v3/projects/47bd44d0c5e84df7a8b641fcc654ec8d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.598769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=47bd44d0c5e84df7a8b641fcc654ec8d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:04.600715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:04.608083 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b59a3a-72ac-439e-80dd-92030fa59fab service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:04.612819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515fed7-4ed6-4427-9aa9-05c55c8a0a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:04.613789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515fed7-4ed6-4427-9aa9-05c55c8a0a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.614039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515fed7-4ed6-4427-9aa9-05c55c8a0a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.614319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515fed7-4ed6-4427-9aa9-05c55c8a0a44 admin admin] PATH_INFO: `/v3/users/e406fb4de0f74824a104965164aaef33` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.615546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515fed7-4ed6-4427-9aa9-05c55c8a0a44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e406fb4de0f74824a104965164aaef33)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:04.617752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515fed7-4ed6-4427-9aa9-05c55c8a0a44 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:04.662280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47bd44d0c5e84df7a8b641fcc654ec8d', 'request_id': 'req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:04.671997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47bd44d0c5e84df7a8b641fcc654ec8d', 'request_id': 'req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:04.681833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8515fed7-4ed6-4427-9aa9-05c55c8a0a44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e406fb4de0f74824a104965164aaef33'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:04.683301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47bd44d0c5e84df7a8b641fcc654ec8d', 'request_id': 'req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:04.689929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8515fed7-4ed6-4427-9aa9-05c55c8a0a44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e406fb4de0f74824a104965164aaef33'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:04.690732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8515fed7-4ed6-4427-9aa9-05c55c8a0a44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e406fb4de0f74824a104965164aaef33'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:04.691538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8515fed7-4ed6-4427-9aa9-05c55c8a0a44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e406fb4de0f74824a104965164aaef33'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:04.698322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] The token cache is being invalidate because project 47bd44d0c5e84df7a8b641fcc654ec8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:04.698613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:04.699428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ea0f74b3-d255-4e11-8e71-cc23c73e1eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:04.701217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 985/1988] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:04 2022] DELETE /identity/v3/projects/47bd44d0c5e84df7a8b641fcc654ec8d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:04.706124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279170e-2e7f-4a33-8bfd-23a8bff8090b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.706409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279170e-2e7f-4a33-8bfd-23a8bff8090b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.706685 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279170e-2e7f-4a33-8bfd-23a8bff8090b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.710122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8515fed7-4ed6-4427-9aa9-05c55c8a0a44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e406fb4de0f74824a104965164aaef33'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:04.726851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9279170e-2e7f-4a33-8bfd-23a8bff8090b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:04.730499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1004/1989] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:04 2022] DELETE /identity/v3/users/e406fb4de0f74824a104965164aaef33 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:04.730807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9279170e-2e7f-4a33-8bfd-23a8bff8090b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:04.732131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e05a9-a7a4-4485-bc17-e974c6fdf9ec None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.732463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e05a9-a7a4-4485-bc17-e974c6fdf9ec None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.732755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e05a9-a7a4-4485-bc17-e974c6fdf9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.757081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:04.760824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-9b4e05a9-a7a4-4485-bc17-e974c6fdf9ec None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:04.762899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9b4e05a9-a7a4-4485-bc17-e974c6fdf9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:04.770032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:04.878790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 986/1990] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:08:04.885954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b179de2-44b9-40a5-b840-4973a9d3f5d6 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.886307 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b179de2-44b9-40a5-b840-4973a9d3f5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.886594 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b179de2-44b9-40a5-b840-4973a9d3f5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.896402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1005/1991] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:04.908717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e05a9-a7a4-4485-bc17-e974c6fdf9ec None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:04.910956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9b4e05a9-a7a4-4485-bc17-e974c6fdf9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:04.926025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3b179de2-44b9-40a5-b840-4973a9d3f5d6 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:04.927277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3b179de2-44b9-40a5-b840-4973a9d3f5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:04.953033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 987/1992] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:04.962940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b179de2-44b9-40a5-b840-4973a9d3f5d6 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:04.982033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b179de2-44b9-40a5-b840-4973a9d3f5d6 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:04.989206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4188ae5-44ba-4efb-a6bc-2ddd9bfa9224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:04.990613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4188ae5-44ba-4efb-a6bc-2ddd9bfa9224 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:04.991093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4188ae5-44ba-4efb-a6bc-2ddd9bfa9224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:04.991371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4188ae5-44ba-4efb-a6bc-2ddd9bfa9224 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:04.992110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4188ae5-44ba-4efb-a6bc-2ddd9bfa9224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:04.992740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4188ae5-44ba-4efb-a6bc-2ddd9bfa9224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:04.997511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4188ae5-44ba-4efb-a6bc-2ddd9bfa9224 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:05.024027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 988/1993] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:05.029894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4188ae5-44ba-4efb-a6bc-2ddd9bfa9224 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:05.044670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4188ae5-44ba-4efb-a6bc-2ddd9bfa9224 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:05.052835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e05a9-a7a4-4485-bc17-e974c6fdf9ec None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:05.055729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9cecd-a72b-4755-99d5-8a60b74a7bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:05.057122 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9cecd-a72b-4755-99d5-8a60b74a7bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:05.057418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9cecd-a72b-4755-99d5-8a60b74a7bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:05.059086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9cecd-a72b-4755-99d5-8a60b74a7bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:05.060502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9cecd-a72b-4755-99d5-8a60b74a7bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:05.063768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15ce7-d55a-4ac0-bb37-d2bf29012336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:05.067177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15ce7-d55a-4ac0-bb37-d2bf29012336 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:05.067512 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15ce7-d55a-4ac0-bb37-d2bf29012336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:05.067798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15ce7-d55a-4ac0-bb37-d2bf29012336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:05.068701 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9cecd-a72b-4755-99d5-8a60b74a7bd5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:05.093297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b15ce7-d55a-4ac0-bb37-d2bf29012336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:05.097280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b15ce7-d55a-4ac0-bb37-d2bf29012336 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:05.129738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1006/1994] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:05.138568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 989/1995] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:05 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:08:05.143146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15ce7-d55a-4ac0-bb37-d2bf29012336 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:05.155484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15ce7-d55a-4ac0-bb37-d2bf29012336 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:05.241695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94432062-78be-4e3c-9e64-a27f3938db03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:05.242482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432062-78be-4e3c-9e64-a27f3938db03 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:05.242775 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432062-78be-4e3c-9e64-a27f3938db03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:05.243053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432062-78be-4e3c-9e64-a27f3938db03 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:05.244070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94432062-78be-4e3c-9e64-a27f3938db03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:05.246667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94432062-78be-4e3c-9e64-a27f3938db03 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:05.285956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1007/1996] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:05 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:08:05.290737 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9cecd-a72b-4755-99d5-8a60b74a7bd5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:05.332607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9cecd-a72b-4755-99d5-8a60b74a7bd5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:05.340350 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31823acb-28d9-4ba9-a699-d12ee84fe89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:05.341678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31823acb-28d9-4ba9-a699-d12ee84fe89f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:05.342042 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31823acb-28d9-4ba9-a699-d12ee84fe89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:05.342550 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31823acb-28d9-4ba9-a699-d12ee84fe89f admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:05.343514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31823acb-28d9-4ba9-a699-d12ee84fe89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:05.345553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31823acb-28d9-4ba9-a699-d12ee84fe89f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:05.363582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 990/1997] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:05.372231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94432062-78be-4e3c-9e64-a27f3938db03 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:05.388014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94432062-78be-4e3c-9e64-a27f3938db03 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:05.394614 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eadc92-c47a-4e01-8ce1-b37db2acabf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:05.395495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eadc92-c47a-4e01-8ce1-b37db2acabf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:05.396393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eadc92-c47a-4e01-8ce1-b37db2acabf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:05.396803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eadc92-c47a-4e01-8ce1-b37db2acabf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:05.397682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eadc92-c47a-4e01-8ce1-b37db2acabf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:05.403548 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eadc92-c47a-4e01-8ce1-b37db2acabf2 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:05.413435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1008/1998] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:05.417353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31823acb-28d9-4ba9-a699-d12ee84fe89f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:05.436926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31823acb-28d9-4ba9-a699-d12ee84fe89f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:05.443027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22806e-deb5-4833-9ebc-d1cf2a16dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:05.444187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22806e-deb5-4833-9ebc-d1cf2a16dc8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:05.445521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22806e-deb5-4833-9ebc-d1cf2a16dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:05.452866 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22806e-deb5-4833-9ebc-d1cf2a16dc8d admin admin] PATH_INFO: `/v3/projects/a2ac32d3021241d7b9eed2ce2040fdaf/users/aed08c8445f24371837dfae9e55c46dd/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:05.480883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22806e-deb5-4833-9ebc-d1cf2a16dc8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ac32d3021241d7b9eed2ce2040fdaf, user_id=aed08c8445f24371837dfae9e55c46dd, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:05.484201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22806e-deb5-4833-9ebc-d1cf2a16dc8d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:05.507808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 991/1999] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:05 2022] PUT /identity/v3/projects/a2ac32d3021241d7b9eed2ce2040fdaf/users/aed08c8445f24371837dfae9e55c46dd/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:05.519129 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2160c27-6b79-4db5-b56c-073e1b8d7fb9 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:05.519510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2160c27-6b79-4db5-b56c-073e1b8d7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:05.519864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2160c27-6b79-4db5-b56c-073e1b8d7fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:05.562927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c2160c27-6b79-4db5-b56c-073e1b8d7fb9 None None] MFA Rules not processed for user `aed08c8445f24371837dfae9e55c46dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:05.564879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c2160c27-6b79-4db5-b56c-073e1b8d7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:05.593720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:05.668591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22806e-deb5-4833-9ebc-d1cf2a16dc8d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:05.670383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1c22806e-deb5-4833-9ebc-d1cf2a16dc8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:05.690109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1009/2000] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:05.699460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2160c27-6b79-4db5-b56c-073e1b8d7fb9 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:05.701301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c2160c27-6b79-4db5-b56c-073e1b8d7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:05.761140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22806e-deb5-4833-9ebc-d1cf2a16dc8d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:05.766673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:05.767546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:05.767963 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:05.768118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] PATH_INFO: `/v3/projects/d534f62f30774ed2ae1f7ead1b20f822` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:05.769332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d534f62f30774ed2ae1f7ead1b20f822)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:05.771685 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:05.789082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2160c27-6b79-4db5-b56c-073e1b8d7fb9 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:05.793693 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b490ba-09a2-461e-969f-235e89944af7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f36041751a446885608f5a3b1f37df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:05.794418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b490ba-09a2-461e-969f-235e89944af7 service glance] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:05.794773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b490ba-09a2-461e-969f-235e89944af7 service glance] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:05.795124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b490ba-09a2-461e-969f-235e89944af7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:05.804413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b490ba-09a2-461e-969f-235e89944af7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:05.805864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b490ba-09a2-461e-969f-235e89944af7 service glance] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:05.815730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1010/2001] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:08:05.825593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:05.838137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd534f62f30774ed2ae1f7ead1b20f822', 'request_id': 'req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:05.844857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd534f62f30774ed2ae1f7ead1b20f822', 'request_id': 'req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:05.854867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd534f62f30774ed2ae1f7ead1b20f822', 'request_id': 'req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:05.868745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] The token cache is being invalidate because project d534f62f30774ed2ae1f7ead1b20f822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:05.869110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:05.869965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:05.871870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 992/2002] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:05 2022] DELETE /identity/v3/projects/d534f62f30774ed2ae1f7ead1b20f822 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:05.877129 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b490ba-09a2-461e-969f-235e89944af7 service glance] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:05.890916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b490ba-09a2-461e-969f-235e89944af7 service glance] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:05.998732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4acbee-3cab-4ed0-a96e-03aa5d1987e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:06.000593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4acbee-3cab-4ed0-a96e-03aa5d1987e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:06.000880 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4acbee-3cab-4ed0-a96e-03aa5d1987e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:06.001648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4acbee-3cab-4ed0-a96e-03aa5d1987e2 admin admin] PATH_INFO: `/v3/users/609fcbe1b30e4199b66f7f36d9cfb94e` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:06.003238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4acbee-3cab-4ed0-a96e-03aa5d1987e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609fcbe1b30e4199b66f7f36d9cfb94e)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:06.005323 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4acbee-3cab-4ed0-a96e-03aa5d1987e2 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:06.092874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1c4acbee-3cab-4ed0-a96e-03aa5d1987e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609fcbe1b30e4199b66f7f36d9cfb94e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:06.100933 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1c4acbee-3cab-4ed0-a96e-03aa5d1987e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609fcbe1b30e4199b66f7f36d9cfb94e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:06.101729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1c4acbee-3cab-4ed0-a96e-03aa5d1987e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609fcbe1b30e4199b66f7f36d9cfb94e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:06.102431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1c4acbee-3cab-4ed0-a96e-03aa5d1987e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609fcbe1b30e4199b66f7f36d9cfb94e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:06.113869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:06.122700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1c4acbee-3cab-4ed0-a96e-03aa5d1987e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609fcbe1b30e4199b66f7f36d9cfb94e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:06.141466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1011/2003] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:05 2022] DELETE /identity/v3/users/609fcbe1b30e4199b66f7f36d9cfb94e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:06.747845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:06.750159 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:06.788467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6de8d-6ab1-45ed-b652-e7cd2b0f5afb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:06.898164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:06.899342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:06.899944 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:06.900726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] PATH_INFO: `/v3/projects/a5ddbb734ff54a529b8dc1df80595ec2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:06.903581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ddbb734ff54a529b8dc1df80595ec2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:06.921681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:06.994037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ddbb734ff54a529b8dc1df80595ec2', 'request_id': 'req-bd9472da-12e2-49da-ba6c-8018d2dbab66'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:07.004023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ddbb734ff54a529b8dc1df80595ec2', 'request_id': 'req-bd9472da-12e2-49da-ba6c-8018d2dbab66'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:07.017133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ddbb734ff54a529b8dc1df80595ec2', 'request_id': 'req-bd9472da-12e2-49da-ba6c-8018d2dbab66'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:07.031855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] The token cache is being invalidate because project a5ddbb734ff54a529b8dc1df80595ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:07.032228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:07.033201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-bd9472da-12e2-49da-ba6c-8018d2dbab66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:07.038499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 993/2004] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:06 2022] DELETE /identity/v3/projects/a5ddbb734ff54a529b8dc1df80595ec2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:07.040919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e974-6687-4ec3-8e04-15c0fd68738a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:07.041428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e974-6687-4ec3-8e04-15c0fd68738a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:07.041731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e974-6687-4ec3-8e04-15c0fd68738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:07.076758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-1935e974-6687-4ec3-8e04-15c0fd68738a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:07.078088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1935e974-6687-4ec3-8e04-15c0fd68738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:07.156876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1012/2005] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:08:07.166966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747332-4782-4cd8-929b-1c456fe96b0b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:07.167254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747332-4782-4cd8-929b-1c456fe96b0b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:07.169726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747332-4782-4cd8-929b-1c456fe96b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:07.204388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9d747332-4782-4cd8-929b-1c456fe96b0b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:07.205709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9d747332-4782-4cd8-929b-1c456fe96b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:07.215232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 994/2006] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:08:07.219362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935e974-6687-4ec3-8e04-15c0fd68738a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:07.237156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935e974-6687-4ec3-8e04-15c0fd68738a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:07.238748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca46b9b-e370-42be-ac24-22bce53f53bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:07.239573 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46b9b-e370-42be-ac24-22bce53f53bb admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:07.240045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46b9b-e370-42be-ac24-22bce53f53bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:07.240299 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca46b9b-e370-42be-ac24-22bce53f53bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:07.241142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca46b9b-e370-42be-ac24-22bce53f53bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:07.241516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca46b9b-e370-42be-ac24-22bce53f53bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:07.243341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca46b9b-e370-42be-ac24-22bce53f53bb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:07.264222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1013/2007] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:07.269368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d747332-4782-4cd8-929b-1c456fe96b0b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:07.282502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d747332-4782-4cd8-929b-1c456fe96b0b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:07.299212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e5e9-3190-474a-8a7e-5a92040afb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:07.301129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e5e9-3190-474a-8a7e-5a92040afb61 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:07.301598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e5e9-3190-474a-8a7e-5a92040afb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:07.302103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e5e9-3190-474a-8a7e-5a92040afb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:07.303674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41e5e9-3190-474a-8a7e-5a92040afb61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:07.307308 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41e5e9-3190-474a-8a7e-5a92040afb61 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:07.344971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 995/2008] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:07 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:07.350296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca46b9b-e370-42be-ac24-22bce53f53bb admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:07.363864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca46b9b-e370-42be-ac24-22bce53f53bb admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:07.462534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6dca8-69de-4321-b282-6db3068196b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:07.463375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6dca8-69de-4321-b282-6db3068196b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:07.463763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6dca8-69de-4321-b282-6db3068196b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:07.464139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6dca8-69de-4321-b282-6db3068196b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:07.465024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6dca8-69de-4321-b282-6db3068196b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:07.472242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6dca8-69de-4321-b282-6db3068196b8 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:07.514990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1014/2009] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:07 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:07.520526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e5e9-3190-474a-8a7e-5a92040afb61 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:07.538432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e5e9-3190-474a-8a7e-5a92040afb61 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:07.554390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79c7b3-b933-4322-a8d6-e53d4b8b632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:07.555082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c7b3-b933-4322-a8d6-e53d4b8b632c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:07.555371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c7b3-b933-4322-a8d6-e53d4b8b632c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:07.555649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c7b3-b933-4322-a8d6-e53d4b8b632c admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:07.556669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79c7b3-b933-4322-a8d6-e53d4b8b632c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:07.558833 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79c7b3-b933-4322-a8d6-e53d4b8b632c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:07.573672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 996/2010] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:07.577998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6dca8-69de-4321-b282-6db3068196b8 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:07.591278 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6dca8-69de-4321-b282-6db3068196b8 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:07.601034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec1bc6-9539-4715-b1f8-73a8dcd3cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:07.602013 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec1bc6-9539-4715-b1f8-73a8dcd3cd4e admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:07.602504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec1bc6-9539-4715-b1f8-73a8dcd3cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:07.602933 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec1bc6-9539-4715-b1f8-73a8dcd3cd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:07.604194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec1bc6-9539-4715-b1f8-73a8dcd3cd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:07.607178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec1bc6-9539-4715-b1f8-73a8dcd3cd4e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:07.618910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1015/2011] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:07.622859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79c7b3-b933-4322-a8d6-e53d4b8b632c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:07.633057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79c7b3-b933-4322-a8d6-e53d4b8b632c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:07.637845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02068d50-c72d-4d41-b055-1ef8732bb87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:07.638818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02068d50-c72d-4d41-b055-1ef8732bb87d admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:07.639170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02068d50-c72d-4d41-b055-1ef8732bb87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:07.639512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02068d50-c72d-4d41-b055-1ef8732bb87d admin admin] PATH_INFO: `/v3/projects/70cba76db31f4973a520d610a60f95d8/users/d1ed4b6313ea4e3cb38819ad46340e69/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:07.655424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02068d50-c72d-4d41-b055-1ef8732bb87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cba76db31f4973a520d610a60f95d8, user_id=d1ed4b6313ea4e3cb38819ad46340e69, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:07.658200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02068d50-c72d-4d41-b055-1ef8732bb87d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:07.660483 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:07.674287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 997/2012] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:07 2022] PUT /identity/v3/projects/70cba76db31f4973a520d610a60f95d8/users/d1ed4b6313ea4e3cb38819ad46340e69/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:07.694646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4fbf7-8287-4979-9a6c-73a46b612024 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:07.695115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4fbf7-8287-4979-9a6c-73a46b612024 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:07.695995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4fbf7-8287-4979-9a6c-73a46b612024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:07.727755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-faa4fbf7-8287-4979-9a6c-73a46b612024 None None] MFA Rules not processed for user `d1ed4b6313ea4e3cb38819ad46340e69`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:07.735213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-faa4fbf7-8287-4979-9a6c-73a46b612024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:07.812246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:07.851498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1016/2013] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:07.856814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02068d50-c72d-4d41-b055-1ef8732bb87d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:07.950734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02068d50-c72d-4d41-b055-1ef8732bb87d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:07.961175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76348e5d-c5b1-4e96-bd8e-a4111e5a701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:07.962456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348e5d-c5b1-4e96-bd8e-a4111e5a701d admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:07.962817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348e5d-c5b1-4e96-bd8e-a4111e5a701d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:07.963173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348e5d-c5b1-4e96-bd8e-a4111e5a701d admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:07.964633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76348e5d-c5b1-4e96-bd8e-a4111e5a701d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:07.966840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76348e5d-c5b1-4e96-bd8e-a4111e5a701d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:08.020426 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 998/2014] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:07 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:08.023570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4fbf7-8287-4979-9a6c-73a46b612024 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:08.055378 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4fbf7-8287-4979-9a6c-73a46b612024 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:08.146051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562d3be-85df-47ab-8399-6f290e54efcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:08.147927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d3be-85df-47ab-8399-6f290e54efcb admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:08.148474 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d3be-85df-47ab-8399-6f290e54efcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:08.149088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562d3be-85df-47ab-8399-6f290e54efcb admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:08.150052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562d3be-85df-47ab-8399-6f290e54efcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:08.153075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562d3be-85df-47ab-8399-6f290e54efcb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:08.179571 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1017/2015] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:08 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:08.184196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76348e5d-c5b1-4e96-bd8e-a4111e5a701d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:08.196183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76348e5d-c5b1-4e96-bd8e-a4111e5a701d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:08.203219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aebfe-b885-42a5-9149-9dd4701ad1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:08.204032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aebfe-b885-42a5-9149-9dd4701ad1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:08.205660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aebfe-b885-42a5-9149-9dd4701ad1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:08.206067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9aebfe-b885-42a5-9149-9dd4701ad1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:08.207903 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9aebfe-b885-42a5-9149-9dd4701ad1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:08.213248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9aebfe-b885-42a5-9149-9dd4701ad1e4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:08.238673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 999/2016] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:08.243121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562d3be-85df-47ab-8399-6f290e54efcb admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:08.263736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562d3be-85df-47ab-8399-6f290e54efcb admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:08.277071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8f43-0a49-43ab-8597-ad480c57b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:08.278046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8f43-0a49-43ab-8597-ad480c57b0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:08.278391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8f43-0a49-43ab-8597-ad480c57b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:08.278693 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf8f43-0a49-43ab-8597-ad480c57b0ae admin admin] PATH_INFO: `/v3/projects/4f86c9a8b025401d92d2736eac0554bf/users/baff7e28c7254591883e93d27ce3f3ec/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:08.312411 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8f43-0a49-43ab-8597-ad480c57b0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f86c9a8b025401d92d2736eac0554bf, user_id=baff7e28c7254591883e93d27ce3f3ec, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:08.315772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf8f43-0a49-43ab-8597-ad480c57b0ae admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:08.343983 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1018/2017] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:08 2022] PUT /identity/v3/projects/4f86c9a8b025401d92d2736eac0554bf/users/baff7e28c7254591883e93d27ce3f3ec/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:08.347970 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aebfe-b885-42a5-9149-9dd4701ad1e4 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:08.366714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9aebfe-b885-42a5-9149-9dd4701ad1e4 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:08.482860 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9643926-d3fd-4592-8955-d5e83e4d0ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:08.483548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9643926-d3fd-4592-8955-d5e83e4d0ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:08.483837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9643926-d3fd-4592-8955-d5e83e4d0ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:08.484115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9643926-d3fd-4592-8955-d5e83e4d0ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:08.485284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9643926-d3fd-4592-8955-d5e83e4d0ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:08.488218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9643926-d3fd-4592-8955-d5e83e4d0ce6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:08.501563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1000/2018] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:08.505442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8f43-0a49-43ab-8597-ad480c57b0ae admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:08.518411 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf8f43-0a49-43ab-8597-ad480c57b0ae admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:08.524696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b490b3-9868-4287-99b9-0ce7772523a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:08.525697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b490b3-9868-4287-99b9-0ce7772523a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:08.526060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b490b3-9868-4287-99b9-0ce7772523a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:08.526415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b490b3-9868-4287-99b9-0ce7772523a9 admin admin] PATH_INFO: `/v3/projects/4f86c9a8b025401d92d2736eac0554bf/users/baff7e28c7254591883e93d27ce3f3ec/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:08.529086 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b490b3-9868-4287-99b9-0ce7772523a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f86c9a8b025401d92d2736eac0554bf, user_id=baff7e28c7254591883e93d27ce3f3ec, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:08.532085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b490b3-9868-4287-99b9-0ce7772523a9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:08.546124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1019/2019] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:08 2022] PUT /identity/v3/projects/4f86c9a8b025401d92d2736eac0554bf/users/baff7e28c7254591883e93d27ce3f3ec/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:08.561883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d416a1-e4aa-4b3a-a2ba-39a3d7e4fb2f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:08.561883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d416a1-e4aa-4b3a-a2ba-39a3d7e4fb2f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:08.561883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d416a1-e4aa-4b3a-a2ba-39a3d7e4fb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:08.603414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-49d416a1-e4aa-4b3a-a2ba-39a3d7e4fb2f None None] MFA Rules not processed for user `baff7e28c7254591883e93d27ce3f3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:08.605998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-49d416a1-e4aa-4b3a-a2ba-39a3d7e4fb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:08.694628 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:08.734498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1001/2020] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:08:08.749218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b490b3-9868-4287-99b9-0ce7772523a9 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:08.751727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-48b490b3-9868-4287-99b9-0ce7772523a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:08.842875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b490b3-9868-4287-99b9-0ce7772523a9 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:08.849340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262d5af-a22e-4d51-be80-e168262f5bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:08.851337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262d5af-a22e-4d51-be80-e168262f5bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:08.851923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262d5af-a22e-4d51-be80-e168262f5bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:08.852532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262d5af-a22e-4d51-be80-e168262f5bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:08.873031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262d5af-a22e-4d51-be80-e168262f5bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:08.874902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262d5af-a22e-4d51-be80-e168262f5bb8 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:08.890247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1020/2021] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:09.692910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d416a1-e4aa-4b3a-a2ba-39a3d7e4fb2f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:09.804440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d416a1-e4aa-4b3a-a2ba-39a3d7e4fb2f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:09.812759 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:09.814044 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:09.814530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:09.814933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] PATH_INFO: `/v3/users/d1ed4b6313ea4e3cb38819ad46340e69` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:09.816652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ed4b6313ea4e3cb38819ad46340e69)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:09.819471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:09.929814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ed4b6313ea4e3cb38819ad46340e69'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:09.930731 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ed4b6313ea4e3cb38819ad46340e69'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:09.939680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ed4b6313ea4e3cb38819ad46340e69'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:09.949913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ed4b6313ea4e3cb38819ad46340e69'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:09.951608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ed4b6313ea4e3cb38819ad46340e69'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:09.973536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1002/2022] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:09 2022] DELETE /identity/v3/users/d1ed4b6313ea4e3cb38819ad46340e69 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:09.978075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba8c1a-3d17-49d6-bd3d-980e89ffd384 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:09.978578 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba8c1a-3d17-49d6-bd3d-980e89ffd384 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:09.978697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba8c1a-3d17-49d6-bd3d-980e89ffd384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:09.999254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-34ba8c1a-3d17-49d6-bd3d-980e89ffd384 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:10.000911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-34ba8c1a-3d17-49d6-bd3d-980e89ffd384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:10.034494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:10.073532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1021/2023] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:10.090586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:10.092811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:10.170084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70e6db-9a27-40df-9742-638427d65fea admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:10.174466 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229afce5-19c5-4f6b-a404-e309315cc889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:10.175357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229afce5-19c5-4f6b-a404-e309315cc889 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:10.175830 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229afce5-19c5-4f6b-a404-e309315cc889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:10.176251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229afce5-19c5-4f6b-a404-e309315cc889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:10.190223 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229afce5-19c5-4f6b-a404-e309315cc889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:10.191779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229afce5-19c5-4f6b-a404-e309315cc889 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:10.203750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1003/2024] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:10.533174 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba8c1a-3d17-49d6-bd3d-980e89ffd384 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:10.534737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-34ba8c1a-3d17-49d6-bd3d-980e89ffd384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:10.548232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba8c1a-3d17-49d6-bd3d-980e89ffd384 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:10.554415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:10.555656 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:10.560705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:10.560705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] PATH_INFO: `/v3/projects/70cba76db31f4973a520d610a60f95d8` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:10.560705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=70cba76db31f4973a520d610a60f95d8)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:10.566207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:10.623295 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70cba76db31f4973a520d610a60f95d8', 'request_id': 'req-d987eeae-eca8-42d7-9d7b-0faacf476d7a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:10.629310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70cba76db31f4973a520d610a60f95d8', 'request_id': 'req-d987eeae-eca8-42d7-9d7b-0faacf476d7a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:10.637839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70cba76db31f4973a520d610a60f95d8', 'request_id': 'req-d987eeae-eca8-42d7-9d7b-0faacf476d7a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:10.654000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] The token cache is being invalidate because project 70cba76db31f4973a520d610a60f95d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:10.654788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:10.655177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:10.657251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1022/2025] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:10 2022] DELETE /identity/v3/projects/70cba76db31f4973a520d610a60f95d8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:10.667782 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229afce5-19c5-4f6b-a404-e309315cc889 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:10.696833 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229afce5-19c5-4f6b-a404-e309315cc889 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:10.719630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:10.801179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7fd9f-c59c-494a-9ea9-9813368554f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:10.802137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7fd9f-c59c-494a-9ea9-9813368554f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:10.802427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7fd9f-c59c-494a-9ea9-9813368554f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:10.802709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7fd9f-c59c-494a-9ea9-9813368554f1 admin admin] PATH_INFO: `/v3/users/baff7e28c7254591883e93d27ce3f3ec` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:10.804071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7fd9f-c59c-494a-9ea9-9813368554f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baff7e28c7254591883e93d27ce3f3ec)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:10.806000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7fd9f-c59c-494a-9ea9-9813368554f1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:10.873478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-09c7fd9f-c59c-494a-9ea9-9813368554f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baff7e28c7254591883e93d27ce3f3ec'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:10.874165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-09c7fd9f-c59c-494a-9ea9-9813368554f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baff7e28c7254591883e93d27ce3f3ec'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:10.885420 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-09c7fd9f-c59c-494a-9ea9-9813368554f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baff7e28c7254591883e93d27ce3f3ec'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:10.894402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-09c7fd9f-c59c-494a-9ea9-9813368554f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baff7e28c7254591883e93d27ce3f3ec'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:10.895085 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-09c7fd9f-c59c-494a-9ea9-9813368554f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baff7e28c7254591883e93d27ce3f3ec'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:10.924184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1004/2026] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:10 2022] DELETE /identity/v3/users/baff7e28c7254591883e93d27ce3f3ec => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:11.408655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:11.410150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:11.443034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987eeae-eca8-42d7-9d7b-0faacf476d7a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:11.636010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:11.637565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:11.637565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:11.637565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] PATH_INFO: `/v3/projects/4f86c9a8b025401d92d2736eac0554bf` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:11.639697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f86c9a8b025401d92d2736eac0554bf)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:11.641772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:11.734662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f86c9a8b025401d92d2736eac0554bf', 'request_id': 'req-90750f8f-bced-416b-b513-9044ff0360ff'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:11.746138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f86c9a8b025401d92d2736eac0554bf', 'request_id': 'req-90750f8f-bced-416b-b513-9044ff0360ff'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:11.747911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:11.759927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f86c9a8b025401d92d2736eac0554bf', 'request_id': 'req-90750f8f-bced-416b-b513-9044ff0360ff'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:11.800094 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] The token cache is being invalidate because project 4f86c9a8b025401d92d2736eac0554bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:11.800736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:11.803830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-90750f8f-bced-416b-b513-9044ff0360ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:11.806946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1023/2027] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:11 2022] DELETE /identity/v3/projects/4f86c9a8b025401d92d2736eac0554bf => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:11.814128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1153c-227c-426e-81dc-7afea08f4156 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:11.814733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1153c-227c-426e-81dc-7afea08f4156 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:11.815695 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1153c-227c-426e-81dc-7afea08f4156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:11.847567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-70d1153c-227c-426e-81dc-7afea08f4156 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:11.849184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-70d1153c-227c-426e-81dc-7afea08f4156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:11.983165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1005/2028] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:11.985588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2289240-e5ea-40a1-8af8-43595c5ae635 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:11.985879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2289240-e5ea-40a1-8af8-43595c5ae635 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:11.986155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2289240-e5ea-40a1-8af8-43595c5ae635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:12.037146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-e2289240-e5ea-40a1-8af8-43595c5ae635 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:12.043673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e2289240-e5ea-40a1-8af8-43595c5ae635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:12.082696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1024/2029] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:12.086797 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1153c-227c-426e-81dc-7afea08f4156 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:12.108341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1153c-227c-426e-81dc-7afea08f4156 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:12.123045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51697b4-364b-46e5-986d-7e6b86926163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:12.123816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51697b4-364b-46e5-986d-7e6b86926163 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:12.124107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51697b4-364b-46e5-986d-7e6b86926163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:12.128471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51697b4-364b-46e5-986d-7e6b86926163 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:12.129311 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51697b4-364b-46e5-986d-7e6b86926163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:12.129638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51697b4-364b-46e5-986d-7e6b86926163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:12.131306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51697b4-364b-46e5-986d-7e6b86926163 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:12.149437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1006/2030] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:12.150413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2289240-e5ea-40a1-8af8-43595c5ae635 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:12.160930 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2289240-e5ea-40a1-8af8-43595c5ae635 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:12.166396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23731b-e1fc-4421-9dea-5e0c8ea6e1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:12.167056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23731b-e1fc-4421-9dea-5e0c8ea6e1ed admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:12.167924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23731b-e1fc-4421-9dea-5e0c8ea6e1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:12.168265 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23731b-e1fc-4421-9dea-5e0c8ea6e1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:12.168963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23731b-e1fc-4421-9dea-5e0c8ea6e1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:12.170867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23731b-e1fc-4421-9dea-5e0c8ea6e1ed admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:12.207580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1025/2031] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:12 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:08:12.211407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51697b4-364b-46e5-986d-7e6b86926163 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:12.222783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51697b4-364b-46e5-986d-7e6b86926163 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:12.236630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:12.292217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d1d1-51e7-491d-a8ec-612612d45b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:12.293776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d1d1-51e7-491d-a8ec-612612d45b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:12.294014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d1d1-51e7-491d-a8ec-612612d45b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:12.294395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6d1d1-51e7-491d-a8ec-612612d45b3f admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:12.295209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6d1d1-51e7-491d-a8ec-612612d45b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:12.297812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6d1d1-51e7-491d-a8ec-612612d45b3f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:12.322869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1007/2032] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:12 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:12.327403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23731b-e1fc-4421-9dea-5e0c8ea6e1ed admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:12.341992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23731b-e1fc-4421-9dea-5e0c8ea6e1ed admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:12.351306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08988b-551a-4ed1-a265-f7098a369eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:12.352082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08988b-551a-4ed1-a265-f7098a369eda admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:12.352512 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08988b-551a-4ed1-a265-f7098a369eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:12.352924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08988b-551a-4ed1-a265-f7098a369eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:12.355316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08988b-551a-4ed1-a265-f7098a369eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:12.358640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08988b-551a-4ed1-a265-f7098a369eda admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:12.385381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1026/2033] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:08:12.390252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d1d1-51e7-491d-a8ec-612612d45b3f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:12.405771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6d1d1-51e7-491d-a8ec-612612d45b3f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:12.412516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17087607-a100-4ebd-82a8-e5c23ee3b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:12.413585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087607-a100-4ebd-82a8-e5c23ee3b75c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:12.413900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087607-a100-4ebd-82a8-e5c23ee3b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:12.414181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087607-a100-4ebd-82a8-e5c23ee3b75c admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:12.414904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17087607-a100-4ebd-82a8-e5c23ee3b75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:12.416567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17087607-a100-4ebd-82a8-e5c23ee3b75c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:12.428677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1008/2034] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:12.432484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08988b-551a-4ed1-a265-f7098a369eda admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:12.464964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08988b-551a-4ed1-a265-f7098a369eda admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:12.470059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50143468-807d-4bae-8ba2-aa4149120516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:12.474038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50143468-807d-4bae-8ba2-aa4149120516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:12.474246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50143468-807d-4bae-8ba2-aa4149120516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:12.474536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50143468-807d-4bae-8ba2-aa4149120516 admin admin] PATH_INFO: `/v3/projects/51a3186707c74af19f012d2468aabe2a/users/a33b7fa77f65470287dc3265a02ef52d/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:12.493677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50143468-807d-4bae-8ba2-aa4149120516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a3186707c74af19f012d2468aabe2a, user_id=a33b7fa77f65470287dc3265a02ef52d, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:12.497825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50143468-807d-4bae-8ba2-aa4149120516 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:12.524416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1027/2035] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:12 2022] PUT /identity/v3/projects/51a3186707c74af19f012d2468aabe2a/users/a33b7fa77f65470287dc3265a02ef52d/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:12.530401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81bca5-f80e-49f3-a2f1-c9bd2d3009f5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:12.530950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81bca5-f80e-49f3-a2f1-c9bd2d3009f5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:12.531687 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81bca5-f80e-49f3-a2f1-c9bd2d3009f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:12.561315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6f81bca5-f80e-49f3-a2f1-c9bd2d3009f5 None None] MFA Rules not processed for user `a33b7fa77f65470287dc3265a02ef52d`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:12.562622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6f81bca5-f80e-49f3-a2f1-c9bd2d3009f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:12.634571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1009/2036] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:12.648138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50143468-807d-4bae-8ba2-aa4149120516 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:12.649993 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-50143468-807d-4bae-8ba2-aa4149120516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:12.717472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50143468-807d-4bae-8ba2-aa4149120516 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:12.722452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f98e3-902e-4e19-836e-1d029d22e3a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:12.723753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f98e3-902e-4e19-836e-1d029d22e3a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:12.724077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f98e3-902e-4e19-836e-1d029d22e3a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:12.724500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f98e3-902e-4e19-836e-1d029d22e3a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:12.735560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f98e3-902e-4e19-836e-1d029d22e3a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:12.737457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f98e3-902e-4e19-836e-1d029d22e3a1 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:12.748901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1028/2037] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:22.629593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:22.743895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=57,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:25.709826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81bca5-f80e-49f3-a2f1-c9bd2d3009f5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:25.795201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81bca5-f80e-49f3-a2f1-c9bd2d3009f5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:25.800241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:25.801323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:25.801710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:25.802092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] PATH_INFO: `/v3/users/a33b7fa77f65470287dc3265a02ef52d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:25.803470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33b7fa77f65470287dc3265a02ef52d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:25.805625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:25.859563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33b7fa77f65470287dc3265a02ef52d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:25.860338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33b7fa77f65470287dc3265a02ef52d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:25.867376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33b7fa77f65470287dc3265a02ef52d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:25.875132 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33b7fa77f65470287dc3265a02ef52d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:25.875797 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33b7fa77f65470287dc3265a02ef52d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:25.893005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1010/2038] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:25 2022] DELETE /identity/v3/users/a33b7fa77f65470287dc3265a02ef52d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:25.897840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9535b7f-a246-4700-905b-88ac5815e3cd None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:25.898288 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9535b7f-a246-4700-905b-88ac5815e3cd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:25.898396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9535b7f-a246-4700-905b-88ac5815e3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:25.916984 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c9535b7f-a246-4700-905b-88ac5815e3cd None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:25.918460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c9535b7f-a246-4700-905b-88ac5815e3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:25.981023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1029/2039] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:25.990398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:25.991824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:26.065195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce03f9-b3cd-48f1-aca4-fbde2384df20 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:26.076827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbfb08-2cc5-4510-9593-8369339ae7c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:26.077652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfb08-2cc5-4510-9593-8369339ae7c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:26.078053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfb08-2cc5-4510-9593-8369339ae7c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:26.078378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfb08-2cc5-4510-9593-8369339ae7c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:26.096998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbfb08-2cc5-4510-9593-8369339ae7c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:26.099367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbfb08-2cc5-4510-9593-8369339ae7c4 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:26.113112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1011/2040] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:26.410133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9535b7f-a246-4700-905b-88ac5815e3cd None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:26.411946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c9535b7f-a246-4700-905b-88ac5815e3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:26.435310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9535b7f-a246-4700-905b-88ac5815e3cd None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:26.442412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:26.443758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:26.444043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:26.444382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] PATH_INFO: `/v3/projects/51a3186707c74af19f012d2468aabe2a` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:26.445584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a3186707c74af19f012d2468aabe2a)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:26.447491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:26.495390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a3186707c74af19f012d2468aabe2a', 'request_id': 'req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:26.500819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a3186707c74af19f012d2468aabe2a', 'request_id': 'req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:26.506813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a3186707c74af19f012d2468aabe2a', 'request_id': 'req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:26.519800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] The token cache is being invalidate because project 51a3186707c74af19f012d2468aabe2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:26.520085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:26.520988 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eed2c71e-5bbb-4de5-84ad-3c98ea7be4ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:26.522516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1030/2041] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:26 2022] DELETE /identity/v3/projects/51a3186707c74af19f012d2468aabe2a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:26.527931 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50541f0a-2bc2-49cc-8908-0af75b8dc13a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:26.528225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50541f0a-2bc2-49cc-8908-0af75b8dc13a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:26.528537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50541f0a-2bc2-49cc-8908-0af75b8dc13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:26.546515 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-50541f0a-2bc2-49cc-8908-0af75b8dc13a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:26.547724 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-50541f0a-2bc2-49cc-8908-0af75b8dc13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:26.564356 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:26.612394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1012/2042] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:26.621230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf29f3-7fe0-4c5c-8bed-6220f0c7b883 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:26.621488 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf29f3-7fe0-4c5c-8bed-6220f0c7b883 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:26.621798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf29f3-7fe0-4c5c-8bed-6220f0c7b883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:26.639945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a1bf29f3-7fe0-4c5c-8bed-6220f0c7b883 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:26.641182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a1bf29f3-7fe0-4c5c-8bed-6220f0c7b883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:26.649315 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1031/2043] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:26.653988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50541f0a-2bc2-49cc-8908-0af75b8dc13a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:26.664270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50541f0a-2bc2-49cc-8908-0af75b8dc13a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:26.669538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40220d23-b676-4779-bcc6-18fc1e261ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:26.670197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40220d23-b676-4779-bcc6-18fc1e261ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:26.670481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40220d23-b676-4779-bcc6-18fc1e261ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:26.670846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40220d23-b676-4779-bcc6-18fc1e261ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:26.671534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40220d23-b676-4779-bcc6-18fc1e261ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:26.671845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40220d23-b676-4779-bcc6-18fc1e261ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:26.673546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40220d23-b676-4779-bcc6-18fc1e261ee4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:26.686113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1013/2044] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:26.691536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf29f3-7fe0-4c5c-8bed-6220f0c7b883 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:26.702192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf29f3-7fe0-4c5c-8bed-6220f0c7b883 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:26.707020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1623aa-c85d-4a1b-961b-4fae1ecf2067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:26.708047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1623aa-c85d-4a1b-961b-4fae1ecf2067 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:26.708512 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1623aa-c85d-4a1b-961b-4fae1ecf2067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:26.708786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1623aa-c85d-4a1b-961b-4fae1ecf2067 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:26.709558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1623aa-c85d-4a1b-961b-4fae1ecf2067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:26.712180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1623aa-c85d-4a1b-961b-4fae1ecf2067 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:26.740501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1032/2045] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:26 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:26.743707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40220d23-b676-4779-bcc6-18fc1e261ee4 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:26.753767 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40220d23-b676-4779-bcc6-18fc1e261ee4 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:26.817045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ae0ff-803d-4d4c-a7dc-c07827e0c225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:26.817721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae0ff-803d-4d4c-a7dc-c07827e0c225 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:26.818008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae0ff-803d-4d4c-a7dc-c07827e0c225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:26.818283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae0ff-803d-4d4c-a7dc-c07827e0c225 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:26.818989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ae0ff-803d-4d4c-a7dc-c07827e0c225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:26.821095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ae0ff-803d-4d4c-a7dc-c07827e0c225 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:26.843375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1014/2046] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:26 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:26.848511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1623aa-c85d-4a1b-961b-4fae1ecf2067 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:26.861155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1623aa-c85d-4a1b-961b-4fae1ecf2067 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:26.866619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7a981-07bf-4b68-b866-28cf8856ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:26.867681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7a981-07bf-4b68-b866-28cf8856ffe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:26.867975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7a981-07bf-4b68-b866-28cf8856ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:26.868741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7a981-07bf-4b68-b866-28cf8856ffe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:26.869455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7a981-07bf-4b68-b866-28cf8856ffe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:26.872764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7a981-07bf-4b68-b866-28cf8856ffe5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:26.891171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1033/2047] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:26.895238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ae0ff-803d-4d4c-a7dc-c07827e0c225 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:26.906745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ae0ff-803d-4d4c-a7dc-c07827e0c225 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:26.911732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12691a5c-5bf8-43bb-8ec1-8cb45ca2d8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:26.912529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12691a5c-5bf8-43bb-8ec1-8cb45ca2d8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:26.912880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12691a5c-5bf8-43bb-8ec1-8cb45ca2d8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:26.913228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12691a5c-5bf8-43bb-8ec1-8cb45ca2d8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:26.914161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12691a5c-5bf8-43bb-8ec1-8cb45ca2d8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:26.917241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12691a5c-5bf8-43bb-8ec1-8cb45ca2d8d5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:26.934438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1015/2048] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:26.935660 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7a981-07bf-4b68-b866-28cf8856ffe5 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:26.946427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7a981-07bf-4b68-b866-28cf8856ffe5 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:26.951151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a631d-40e3-4788-bb79-1152c067212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:26.952097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a631d-40e3-4788-bb79-1152c067212e admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:26.952437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a631d-40e3-4788-bb79-1152c067212e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:26.952866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a631d-40e3-4788-bb79-1152c067212e admin admin] PATH_INFO: `/v3/projects/785a5e2316994c6296dc0083ab0f7ec7/users/32dc34f2356a405992b9130ba6df7335/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:26.968211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a631d-40e3-4788-bb79-1152c067212e admin admin] RBAC: Authorizing `identity:create_grant(project_id=785a5e2316994c6296dc0083ab0f7ec7, user_id=32dc34f2356a405992b9130ba6df7335, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:26.970929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a631d-40e3-4788-bb79-1152c067212e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:26.984532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1034/2049] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:26 2022] PUT /identity/v3/projects/785a5e2316994c6296dc0083ab0f7ec7/users/32dc34f2356a405992b9130ba6df7335/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:26.995474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9697f-1734-4e7f-ba5b-71a6be730a3c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:26.995785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9697f-1734-4e7f-ba5b-71a6be730a3c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:26.996065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9697f-1734-4e7f-ba5b-71a6be730a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:27.022910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-37e9697f-1734-4e7f-ba5b-71a6be730a3c None None] MFA Rules not processed for user `32dc34f2356a405992b9130ba6df7335`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:27.024184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-37e9697f-1734-4e7f-ba5b-71a6be730a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:27.102204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1016/2050] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:27.113118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a631d-40e3-4788-bb79-1152c067212e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:27.114894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-344a631d-40e3-4788-bb79-1152c067212e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:27.138895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:27.176625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a631d-40e3-4788-bb79-1152c067212e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:27.180751 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3c7a3-6f05-4f25-9f88-a585596fb4d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:27.181399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3c7a3-6f05-4f25-9f88-a585596fb4d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:27.181683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3c7a3-6f05-4f25-9f88-a585596fb4d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:27.181958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3c7a3-6f05-4f25-9f88-a585596fb4d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:27.191366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3c7a3-6f05-4f25-9f88-a585596fb4d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:27.192901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3c7a3-6f05-4f25-9f88-a585596fb4d3 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:27.203689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1035/2051] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:30.906369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dc08d-f897-449c-8678-f740a935d25b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:30.906826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dc08d-f897-449c-8678-f740a935d25b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:30.906826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dc08d-f897-449c-8678-f740a935d25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:30.929415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1f7dc08d-f897-449c-8678-f740a935d25b None None] MFA Rules not processed for user `2525ac7476134b47956db1c6f5719498`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:30.931142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1f7dc08d-f897-449c-8678-f740a935d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:30.944038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:30.999381 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1017/2052] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:32.002947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279093e1-85c6-482a-97f1-c4a744962041 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:32.003473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279093e1-85c6-482a-97f1-c4a744962041 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:32.003556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279093e1-85c6-482a-97f1-c4a744962041 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:32.005245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1036/2053] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:08:32.021650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85634-c726-44f9-a9a3-bb6b9639b31d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:32.022108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85634-c726-44f9-a9a3-bb6b9639b31d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:32.022210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85634-c726-44f9-a9a3-bb6b9639b31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:32.058248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-adf85634-c726-44f9-a9a3-bb6b9639b31d None None] MFA Rules not processed for user `0a5e0b53aafc4bf3a23a7882ed12a89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:32.060374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-adf85634-c726-44f9-a9a3-bb6b9639b31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:32.097866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279093e1-85c6-482a-97f1-c4a744962041 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:32.102635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-279093e1-85c6-482a-97f1-c4a744962041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:32.173435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1018/2054] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:08:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:32.175069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf85634-c726-44f9-a9a3-bb6b9639b31d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:32.177235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-adf85634-c726-44f9-a9a3-bb6b9639b31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:32.254050 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279093e1-85c6-482a-97f1-c4a744962041 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:32.265248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:32.266303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:32.266792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:32.267153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] PATH_INFO: `/v3/users/7f9f7b8e1f534e8f86d9cde7c0b4f633` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:32.272724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9f7b8e1f534e8f86d9cde7c0b4f633)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:32.276986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:32.328908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf85634-c726-44f9-a9a3-bb6b9639b31d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:32.335672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4fb17-bed9-43a9-8213-96dce2003e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:32.336950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fb17-bed9-43a9-8213-96dce2003e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:32.337641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fb17-bed9-43a9-8213-96dce2003e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:32.338109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fb17-bed9-43a9-8213-96dce2003e55 admin admin] PATH_INFO: `/v3/users/cf06e7683bc942df9dd9184e39e568e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:32.340157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4fb17-bed9-43a9-8213-96dce2003e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf06e7683bc942df9dd9184e39e568e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:32.343896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4fb17-bed9-43a9-8213-96dce2003e55 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:32.349792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9f7b8e1f534e8f86d9cde7c0b4f633'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:32.360917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9f7b8e1f534e8f86d9cde7c0b4f633'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:32.361714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9f7b8e1f534e8f86d9cde7c0b4f633'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:32.362599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9f7b8e1f534e8f86d9cde7c0b4f633'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:32.397111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9f7b8e1f534e8f86d9cde7c0b4f633'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:32.422226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9af4fb17-bed9-43a9-8213-96dce2003e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf06e7683bc942df9dd9184e39e568e7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:32.423097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9af4fb17-bed9-43a9-8213-96dce2003e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf06e7683bc942df9dd9184e39e568e7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:32.430464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1037/2055] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:32 2022] DELETE /identity/v3/users/7f9f7b8e1f534e8f86d9cde7c0b4f633 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:32.431451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:32.434789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:32.451403 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9af4fb17-bed9-43a9-8213-96dce2003e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf06e7683bc942df9dd9184e39e568e7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:32.464792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:32.482279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9af4fb17-bed9-43a9-8213-96dce2003e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf06e7683bc942df9dd9184e39e568e7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:32.483003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9af4fb17-bed9-43a9-8213-96dce2003e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf06e7683bc942df9dd9184e39e568e7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:32.524395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1019/2056] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:32 2022] DELETE /identity/v3/users/cf06e7683bc942df9dd9184e39e568e7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:32.532723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3665a-c34f-43da-8758-c509f7a3c9eb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:32.533082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3665a-c34f-43da-8758-c509f7a3c9eb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:32.533279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3665a-c34f-43da-8758-c509f7a3c9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:32.569787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-22d3665a-c34f-43da-8758-c509f7a3c9eb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:32.571070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-22d3665a-c34f-43da-8758-c509f7a3c9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:32.611169 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:32.693255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b0adf-4312-471f-aae0-1312c28fdc0a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:32.709923 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1020/2057] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:32.778177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3665a-c34f-43da-8758-c509f7a3c9eb None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:32.779909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-22d3665a-c34f-43da-8758-c509f7a3c9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:32.841248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c6226-f400-4a2e-a0a7-2b8879e819ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e0b53aafc4bf3a23a7882ed12a89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:32.841960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c6226-f400-4a2e-a0a7-2b8879e819ac service placement] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:32.842247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c6226-f400-4a2e-a0a7-2b8879e819ac service placement] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:32.842535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c6226-f400-4a2e-a0a7-2b8879e819ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:32.848473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6c1c6226-f400-4a2e-a0a7-2b8879e819ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:32.878263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c6226-f400-4a2e-a0a7-2b8879e819ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:32.880016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c6226-f400-4a2e-a0a7-2b8879e819ac service placement] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:32.885015 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3665a-c34f-43da-8758-c509f7a3c9eb None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:32.891940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c5864-39be-4e2f-8027-9b0c2cd52dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:32.892818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c5864-39be-4e2f-8027-9b0c2cd52dce service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:32.893346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c5864-39be-4e2f-8027-9b0c2cd52dce service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:32.893720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c5864-39be-4e2f-8027-9b0c2cd52dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:32.901260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1038/2058] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:32.902305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c6226-f400-4a2e-a0a7-2b8879e819ac service placement] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:32.904432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6c1c6226-f400-4a2e-a0a7-2b8879e819ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:32.909422 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c5864-39be-4e2f-8027-9b0c2cd52dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:32.911221 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c5864-39be-4e2f-8027-9b0c2cd52dce service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:32.922929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c6226-f400-4a2e-a0a7-2b8879e819ac service placement] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:32.928550 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:32.929852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:32.931886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:32.931886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] PATH_INFO: `/v3/projects/ad47dbec17954b6da5aee78946535698` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:32.933668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad47dbec17954b6da5aee78946535698)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:32.939818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:32.961438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1021/2059] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:08:33.039444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad47dbec17954b6da5aee78946535698', 'request_id': 'req-41911b4a-322a-4f8e-bcfd-1e5227dffd45'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.048179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad47dbec17954b6da5aee78946535698', 'request_id': 'req-41911b4a-322a-4f8e-bcfd-1e5227dffd45'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.071781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad47dbec17954b6da5aee78946535698', 'request_id': 'req-41911b4a-322a-4f8e-bcfd-1e5227dffd45'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.087170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] The token cache is being invalidate because project ad47dbec17954b6da5aee78946535698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:33.087463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.090746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-41911b4a-322a-4f8e-bcfd-1e5227dffd45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.092532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1039/2060] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:32 2022] DELETE /identity/v3/projects/ad47dbec17954b6da5aee78946535698 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:33.097689 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce6deb-9d94-47e8-95c0-973438bdc8c0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:33.098255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce6deb-9d94-47e8-95c0-973438bdc8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:33.098353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce6deb-9d94-47e8-95c0-973438bdc8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:33.136564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-96ce6deb-9d94-47e8-95c0-973438bdc8c0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:33.137968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-96ce6deb-9d94-47e8-95c0-973438bdc8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:33.260772 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1022/2061] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:08:33.269150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecd03d-1954-45e1-b9f7-b8aa99204a67 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:33.269670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecd03d-1954-45e1-b9f7-b8aa99204a67 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:33.270153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecd03d-1954-45e1-b9f7-b8aa99204a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:33.297625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-e1ecd03d-1954-45e1-b9f7-b8aa99204a67 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:33.299093 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e1ecd03d-1954-45e1-b9f7-b8aa99204a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:33.308419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1040/2062] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:33.313511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce6deb-9d94-47e8-95c0-973438bdc8c0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:33.325013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce6deb-9d94-47e8-95c0-973438bdc8c0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:33.330615 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b80136-7a1b-4981-9a78-d4857fddda76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:33.331270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b80136-7a1b-4981-9a78-d4857fddda76 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:33.331514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b80136-7a1b-4981-9a78-d4857fddda76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:33.331752 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b80136-7a1b-4981-9a78-d4857fddda76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:33.332520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b80136-7a1b-4981-9a78-d4857fddda76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:33.333116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b80136-7a1b-4981-9a78-d4857fddda76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:33.334404 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b80136-7a1b-4981-9a78-d4857fddda76 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:33.351132 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1023/2063] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:33.354682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecd03d-1954-45e1-b9f7-b8aa99204a67 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:33.363116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b80136-7a1b-4981-9a78-d4857fddda76 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:33.365523 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-17b80136-7a1b-4981-9a78-d4857fddda76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:33.368773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecd03d-1954-45e1-b9f7-b8aa99204a67 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:33.382491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a8330-a194-49f3-8aa9-a43ad17e59b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:33.383534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8330-a194-49f3-8aa9-a43ad17e59b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:33.384711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8330-a194-49f3-8aa9-a43ad17e59b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:33.384892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b80136-7a1b-4981-9a78-d4857fddda76 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:33.385683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a8330-a194-49f3-8aa9-a43ad17e59b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:33.386631 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a8330-a194-49f3-8aa9-a43ad17e59b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:33.390307 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:33.391190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:33.391521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:33.391736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] PATH_INFO: `/v3/projects/4f7f57682b5e4ae6ba020ed493195038` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:33.396966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7f57682b5e4ae6ba020ed493195038)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:33.399267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:33.401252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a8330-a194-49f3-8aa9-a43ad17e59b9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:33.402690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:33.455996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1041/2064] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:33 2022] POST /identity/v3/projects => generated 355 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:33.460507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a8330-a194-49f3-8aa9-a43ad17e59b9 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:33.489054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7f57682b5e4ae6ba020ed493195038', 'request_id': 'req-47f41d70-365d-48b6-a23d-3cdb29675ff3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.498746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:33.498993 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7f57682b5e4ae6ba020ed493195038', 'request_id': 'req-47f41d70-365d-48b6-a23d-3cdb29675ff3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.518862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7f57682b5e4ae6ba020ed493195038', 'request_id': 'req-47f41d70-365d-48b6-a23d-3cdb29675ff3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.545091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] The token cache is being invalidate because project 4f7f57682b5e4ae6ba020ed493195038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:33.545442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.546188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.551182 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1024/2065] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:33 2022] DELETE /identity/v3/projects/4f7f57682b5e4ae6ba020ed493195038 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:33.552413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:33.554335 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:33.557128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a8330-a194-49f3-8aa9-a43ad17e59b9 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:33.663219 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef147a63-f31b-4eb1-a550-55d9d03123c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:33.664127 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef147a63-f31b-4eb1-a550-55d9d03123c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:33.664448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef147a63-f31b-4eb1-a550-55d9d03123c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:33.664787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef147a63-f31b-4eb1-a550-55d9d03123c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:33.665479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef147a63-f31b-4eb1-a550-55d9d03123c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:33.668506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef147a63-f31b-4eb1-a550-55d9d03123c3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:33.674158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f41d70-365d-48b6-a23d-3cdb29675ff3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:33.683664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca987773-ab01-4474-9d21-d9100f03a370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:33.685013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987773-ab01-4474-9d21-d9100f03a370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:33.685660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987773-ab01-4474-9d21-d9100f03a370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:33.686002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987773-ab01-4474-9d21-d9100f03a370 admin admin] PATH_INFO: `/v3/users/bf467752b636493e95da7eca7ba630d2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:33.688214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca987773-ab01-4474-9d21-d9100f03a370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf467752b636493e95da7eca7ba630d2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:33.690253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca987773-ab01-4474-9d21-d9100f03a370 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:33.691467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1042/2066] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:33 2022] POST /identity/v3/users => generated 278 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:33.695271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef147a63-f31b-4eb1-a550-55d9d03123c3 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:33.696910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ef147a63-f31b-4eb1-a550-55d9d03123c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:33.710289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef147a63-f31b-4eb1-a550-55d9d03123c3 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:33.716268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f085b0-2bb3-4212-946b-f5a2086904a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:33.716969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f085b0-2bb3-4212-946b-f5a2086904a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:33.717283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f085b0-2bb3-4212-946b-f5a2086904a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:33.717578 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f085b0-2bb3-4212-946b-f5a2086904a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:33.718658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f085b0-2bb3-4212-946b-f5a2086904a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:33.720187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f085b0-2bb3-4212-946b-f5a2086904a5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:33.743894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1043/2067] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:08:33.748210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f085b0-2bb3-4212-946b-f5a2086904a5 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:33.752462 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ca987773-ab01-4474-9d21-d9100f03a370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf467752b636493e95da7eca7ba630d2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.753208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ca987773-ab01-4474-9d21-d9100f03a370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf467752b636493e95da7eca7ba630d2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.766474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ca987773-ab01-4474-9d21-d9100f03a370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf467752b636493e95da7eca7ba630d2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.767677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f085b0-2bb3-4212-946b-f5a2086904a5 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:33.776194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0075f0-abbf-4de6-974a-a96c5f77be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:33.777304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0075f0-abbf-4de6-974a-a96c5f77be9d admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:33.777598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0075f0-abbf-4de6-974a-a96c5f77be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:33.777883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0075f0-abbf-4de6-974a-a96c5f77be9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:33.778669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0075f0-abbf-4de6-974a-a96c5f77be9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:33.780802 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0075f0-abbf-4de6-974a-a96c5f77be9d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:33.783094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ca987773-ab01-4474-9d21-d9100f03a370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf467752b636493e95da7eca7ba630d2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.785379 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ca987773-ab01-4474-9d21-d9100f03a370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf467752b636493e95da7eca7ba630d2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:33.793836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1044/2068] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:33.800735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0075f0-abbf-4de6-974a-a96c5f77be9d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:33.802891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-aa0075f0-abbf-4de6-974a-a96c5f77be9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:33.821829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1025/2069] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:33 2022] DELETE /identity/v3/users/bf467752b636493e95da7eca7ba630d2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:33.822495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0075f0-abbf-4de6-974a-a96c5f77be9d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:33.916194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95477ea7-f630-4d67-83c9-e6b285d559db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:33.917725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95477ea7-f630-4d67-83c9-e6b285d559db admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:33.918010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95477ea7-f630-4d67-83c9-e6b285d559db admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:33.918335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95477ea7-f630-4d67-83c9-e6b285d559db admin admin] PATH_INFO: `/v3/projects/530104917040497fb8ab0f1c2ac58a42/users/9f6d412273874a6f9b170ecc4af5055b/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:33.940593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95477ea7-f630-4d67-83c9-e6b285d559db admin admin] RBAC: Authorizing `identity:create_grant(project_id=530104917040497fb8ab0f1c2ac58a42, user_id=9f6d412273874a6f9b170ecc4af5055b, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:33.943932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95477ea7-f630-4d67-83c9-e6b285d559db admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:33.979672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1045/2070] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:33 2022] PUT /identity/v3/projects/530104917040497fb8ab0f1c2ac58a42/users/9f6d412273874a6f9b170ecc4af5055b/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:33.989436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5e4a3-33af-4055-9882-d8f58c11ad9b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:33.989928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5e4a3-33af-4055-9882-d8f58c11ad9b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:33.990212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5e4a3-33af-4055-9882-d8f58c11ad9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:34.049803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:34.057534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95477ea7-f630-4d67-83c9-e6b285d559db admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:34.062705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-95477ea7-f630-4d67-83c9-e6b285d559db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:34.076296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3de5e4a3-33af-4055-9882-d8f58c11ad9b None None] MFA Rules not processed for user `9f6d412273874a6f9b170ecc4af5055b`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:34.077698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3de5e4a3-33af-4055-9882-d8f58c11ad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:34.208207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:34.244345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1026/2071] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:33 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:34.248352 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5e4a3-33af-4055-9882-d8f58c11ad9b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:34.265732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95477ea7-f630-4d67-83c9-e6b285d559db admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:34.272886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:34.273427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5e4a3-33af-4055-9882-d8f58c11ad9b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:34.274502 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:34.274792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:34.275759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] PATH_INFO: `/v3/users/aed08c8445f24371837dfae9e55c46dd` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:34.278256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed08c8445f24371837dfae9e55c46dd)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:34.280243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:34.285742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749349eb-3d4b-44e1-b8e8-f8ba51adb25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:34.286488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749349eb-3d4b-44e1-b8e8-f8ba51adb25b admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:34.286705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749349eb-3d4b-44e1-b8e8-f8ba51adb25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:34.286988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749349eb-3d4b-44e1-b8e8-f8ba51adb25b admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:34.287690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749349eb-3d4b-44e1-b8e8-f8ba51adb25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:34.289660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749349eb-3d4b-44e1-b8e8-f8ba51adb25b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:34.357170 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1027/2072] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:34 2022] POST /identity/v3/projects => generated 357 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:34.362720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749349eb-3d4b-44e1-b8e8-f8ba51adb25b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:34.368747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-749349eb-3d4b-44e1-b8e8-f8ba51adb25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:34.382282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed08c8445f24371837dfae9e55c46dd'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:34.391385 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed08c8445f24371837dfae9e55c46dd'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:34.392368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed08c8445f24371837dfae9e55c46dd'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:34.393716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed08c8445f24371837dfae9e55c46dd'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:34.427459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed08c8445f24371837dfae9e55c46dd'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:34.454582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1046/2073] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:34 2022] DELETE /identity/v3/users/aed08c8445f24371837dfae9e55c46dd => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:34.456036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:34.457656 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:34.475125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749349eb-3d4b-44e1-b8e8-f8ba51adb25b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:34.558938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350e58c-fc84-406e-87a1-0d9a50fc1abd admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:34.563313 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:34.563765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bd8c0-2266-4ec9-a045-0e2826312fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:34.564338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:34.564644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:34.564753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bd8c0-2266-4ec9-a045-0e2826312fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:34.564952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] PATH_INFO: `/v3/projects/eee24d2e56a140a996377cc8ab58c619` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:34.565052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bd8c0-2266-4ec9-a045-0e2826312fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:34.565807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bd8c0-2266-4ec9-a045-0e2826312fdf admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:34.566160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee24d2e56a140a996377cc8ab58c619)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:34.566284 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bd8c0-2266-4ec9-a045-0e2826312fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:34.568203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:34.568358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bd8c0-2266-4ec9-a045-0e2826312fdf admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:34.598079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1047/2074] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:34 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:34.601710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4236d-6c13-41ad-bca7-6d655e8f8fcd None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:34.602169 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4236d-6c13-41ad-bca7-6d655e8f8fcd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:34.604450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4236d-6c13-41ad-bca7-6d655e8f8fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:34.613605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:34.628804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-1da4236d-6c13-41ad-bca7-6d655e8f8fcd None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:34.630381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1da4236d-6c13-41ad-bca7-6d655e8f8fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:34.633440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee24d2e56a140a996377cc8ab58c619', 'request_id': 'req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:34.655294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee24d2e56a140a996377cc8ab58c619', 'request_id': 'req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:34.673708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:34.685073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee24d2e56a140a996377cc8ab58c619', 'request_id': 'req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:34.710909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] The token cache is being invalidate because project eee24d2e56a140a996377cc8ab58c619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:34.711281 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:34.712383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:34.717976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1028/2075] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:34 2022] DELETE /identity/v3/projects/eee24d2e56a140a996377cc8ab58c619 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:34.718960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:34.720691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:34.740892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1048/2076] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:34.742358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df21e-e4d3-4cc0-8815-ead441fc844a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:34.742646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df21e-e4d3-4cc0-8815-ead441fc844a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:34.742920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df21e-e4d3-4cc0-8815-ead441fc844a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:34.744601 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc4fd6-8420-4b4c-b2d6-231a2b2da7fe admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:34.753559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ff3ab-f2ff-402f-9b51-cbd88bfbe8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:34.754753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ff3ab-f2ff-402f-9b51-cbd88bfbe8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:34.755226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ff3ab-f2ff-402f-9b51-cbd88bfbe8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:34.755739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ff3ab-f2ff-402f-9b51-cbd88bfbe8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:34.756704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ff3ab-f2ff-402f-9b51-cbd88bfbe8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:34.759399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ff3ab-f2ff-402f-9b51-cbd88bfbe8c0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:34.763812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4b8df21e-e4d3-4cc0-8815-ead441fc844a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:34.765119 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4b8df21e-e4d3-4cc0-8815-ead441fc844a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:34.773534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1029/2077] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:34.775056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ff3ab-f2ff-402f-9b51-cbd88bfbe8c0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:34.776609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1049/2078] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:34.778500 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-da4ff3ab-f2ff-402f-9b51-cbd88bfbe8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:34.779606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8df21e-e4d3-4cc0-8815-ead441fc844a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:34.797390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8df21e-e4d3-4cc0-8815-ead441fc844a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:34.804240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f24c2e-6580-4275-82e8-26eddf8b5eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:34.805105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f24c2e-6580-4275-82e8-26eddf8b5eda admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:34.805388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f24c2e-6580-4275-82e8-26eddf8b5eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:34.805969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f24c2e-6580-4275-82e8-26eddf8b5eda admin admin] PATH_INFO: `/v3/projects/091923b24b40400ea225c1f184c3551f/users/e2a21cc1ac6241348436808c7bf4d2e3/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:34.834033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f24c2e-6580-4275-82e8-26eddf8b5eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=091923b24b40400ea225c1f184c3551f, user_id=e2a21cc1ac6241348436808c7bf4d2e3, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:34.844483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f24c2e-6580-4275-82e8-26eddf8b5eda admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:34.858444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ff3ab-f2ff-402f-9b51-cbd88bfbe8c0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:34.865468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626c9d3-faef-4f7b-a6c7-ea1f4f7275a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:34.866191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626c9d3-faef-4f7b-a6c7-ea1f4f7275a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:34.866500 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626c9d3-faef-4f7b-a6c7-ea1f4f7275a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:34.866769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626c9d3-faef-4f7b-a6c7-ea1f4f7275a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:34.872460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1050/2079] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:34 2022] PUT /identity/v3/projects/091923b24b40400ea225c1f184c3551f/users/e2a21cc1ac6241348436808c7bf4d2e3/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:34.874403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ea0d2-2da1-45e7-83af-93a07000293f None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:34.875047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ea0d2-2da1-45e7-83af-93a07000293f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:34.875208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ea0d2-2da1-45e7-83af-93a07000293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:34.879629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626c9d3-faef-4f7b-a6c7-ea1f4f7275a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:34.881427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626c9d3-faef-4f7b-a6c7-ea1f4f7275a0 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:34.893762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1030/2080] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:34.895192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626c9d3-faef-4f7b-a6c7-ea1f4f7275a0 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:34.895593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-656ea0d2-2da1-45e7-83af-93a07000293f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:34.896803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-656ea0d2-2da1-45e7-83af-93a07000293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:34.907163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626c9d3-faef-4f7b-a6c7-ea1f4f7275a0 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:34.997015 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1051/2081] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:35.004176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ea0d2-2da1-45e7-83af-93a07000293f None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.004793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139fecf-7ae9-43af-aaab-62cdb927352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.005383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139fecf-7ae9-43af-aaab-62cdb927352a admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.006012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139fecf-7ae9-43af-aaab-62cdb927352a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.006012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139fecf-7ae9-43af-aaab-62cdb927352a admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.006841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139fecf-7ae9-43af-aaab-62cdb927352a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.008499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139fecf-7ae9-43af-aaab-62cdb927352a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.020981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ea0d2-2da1-45e7-83af-93a07000293f None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.025704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1031/2082] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:35.028160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557dbb5-48a2-41c7-bd9a-bfc7250b6b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.028768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139fecf-7ae9-43af-aaab-62cdb927352a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.029174 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557dbb5-48a2-41c7-bd9a-bfc7250b6b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.029617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557dbb5-48a2-41c7-bd9a-bfc7250b6b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.030035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557dbb5-48a2-41c7-bd9a-bfc7250b6b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.031106 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557dbb5-48a2-41c7-bd9a-bfc7250b6b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:35.032107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557dbb5-48a2-41c7-bd9a-bfc7250b6b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.034862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557dbb5-48a2-41c7-bd9a-bfc7250b6b11 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.056863 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139fecf-7ae9-43af-aaab-62cdb927352a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.066650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1052/2083] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:35.067200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e4e03-8a1c-4cc9-b7c6-df063cca1299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.067609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557dbb5-48a2-41c7-bd9a-bfc7250b6b11 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.068242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4e03-8a1c-4cc9-b7c6-df063cca1299 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.071570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4e03-8a1c-4cc9-b7c6-df063cca1299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.071743 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e4e03-8a1c-4cc9-b7c6-df063cca1299 admin admin] PATH_INFO: `/v3/projects/091923b24b40400ea225c1f184c3551f/users/e2a21cc1ac6241348436808c7bf4d2e3/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.076493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e4e03-8a1c-4cc9-b7c6-df063cca1299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091923b24b40400ea225c1f184c3551f, user_id=e2a21cc1ac6241348436808c7bf4d2e3, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.082110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557dbb5-48a2-41c7-bd9a-bfc7250b6b11 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.082672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e4e03-8a1c-4cc9-b7c6-df063cca1299 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.094972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54c03a-3e7a-4154-b340-f8458ffdf213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.095700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c03a-3e7a-4154-b340-f8458ffdf213 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.095985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c03a-3e7a-4154-b340-f8458ffdf213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.097728 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54c03a-3e7a-4154-b340-f8458ffdf213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.097728 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54c03a-3e7a-4154-b340-f8458ffdf213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.105249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1032/2084] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:35 2022] PUT /identity/v3/projects/091923b24b40400ea225c1f184c3551f/users/e2a21cc1ac6241348436808c7bf4d2e3/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:35.112562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54c03a-3e7a-4154-b340-f8458ffdf213 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.121858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3ce7-4861-4ee6-b7a9-c3bdcd2da881 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.122151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3ce7-4861-4ee6-b7a9-c3bdcd2da881 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.122432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3ce7-4861-4ee6-b7a9-c3bdcd2da881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.160376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1053/2085] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:35 2022] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:35.162094 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54c03a-3e7a-4154-b340-f8458ffdf213 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.169678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-94dc3ce7-4861-4ee6-b7a9-c3bdcd2da881 None None] MFA Rules not processed for user `e2a21cc1ac6241348436808c7bf4d2e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:35.177732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-94dc3ce7-4861-4ee6-b7a9-c3bdcd2da881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:35.212338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:35.254585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54c03a-3e7a-4154-b340-f8458ffdf213 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.265922 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ad210-c143-405d-8cd9-271944d72d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.267226 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ad210-c143-405d-8cd9-271944d72d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.268498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ad210-c143-405d-8cd9-271944d72d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.268856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ad210-c143-405d-8cd9-271944d72d24 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.269640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ad210-c143-405d-8cd9-271944d72d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.273554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ad210-c143-405d-8cd9-271944d72d24 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.295866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:35.305969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1054/2086] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:35 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:35.308684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ad210-c143-405d-8cd9-271944d72d24 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.311047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1033/2087] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:35 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:35.313377 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc3ce7-4861-4ee6-b7a9-c3bdcd2da881 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.315433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-94dc3ce7-4861-4ee6-b7a9-c3bdcd2da881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:35.326096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ad210-c143-405d-8cd9-271944d72d24 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.331276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f893cf-1f2a-4440-ba6b-25fd44bd44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.331947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f893cf-1f2a-4440-ba6b-25fd44bd44d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.332235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f893cf-1f2a-4440-ba6b-25fd44bd44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.332550 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f893cf-1f2a-4440-ba6b-25fd44bd44d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.333287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f893cf-1f2a-4440-ba6b-25fd44bd44d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.334522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc3ce7-4861-4ee6-b7a9-c3bdcd2da881 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.334906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f893cf-1f2a-4440-ba6b-25fd44bd44d6 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.340875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.342269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.342903 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.343141 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] PATH_INFO: `/v3/projects/a2ac32d3021241d7b9eed2ce2040fdaf` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.344897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ac32d3021241d7b9eed2ce2040fdaf)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.346858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.349939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1055/2088] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:35.349939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f893cf-1f2a-4440-ba6b-25fd44bd44d6 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.352016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-90f893cf-1f2a-4440-ba6b-25fd44bd44d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:35.418061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ac32d3021241d7b9eed2ce2040fdaf', 'request_id': 'req-b7969fde-79da-416b-89dc-7cd349abaf8d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:35.428928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ac32d3021241d7b9eed2ce2040fdaf', 'request_id': 'req-b7969fde-79da-416b-89dc-7cd349abaf8d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:35.429109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f893cf-1f2a-4440-ba6b-25fd44bd44d6 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.438128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ac32d3021241d7b9eed2ce2040fdaf', 'request_id': 'req-b7969fde-79da-416b-89dc-7cd349abaf8d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:35.450891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] The token cache is being invalidate because project a2ac32d3021241d7b9eed2ce2040fdaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:35.451235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:35.451856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:35.453841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1034/2089] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:35 2022] DELETE /identity/v3/projects/a2ac32d3021241d7b9eed2ce2040fdaf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:35.454832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.455847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:35.492402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cbcd6-1dc8-455d-884c-5cd7b3478816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.493562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cbcd6-1dc8-455d-884c-5cd7b3478816 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.493940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cbcd6-1dc8-455d-884c-5cd7b3478816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.494292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cbcd6-1dc8-455d-884c-5cd7b3478816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.497398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-319cbcd6-1dc8-455d-884c-5cd7b3478816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:35.544515 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7969fde-79da-416b-89dc-7cd349abaf8d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.549417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319ea35-65d2-4e8a-96cb-47e011143e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.550095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ea35-65d2-4e8a-96cb-47e011143e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.550490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ea35-65d2-4e8a-96cb-47e011143e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.550645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319ea35-65d2-4e8a-96cb-47e011143e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.551729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319ea35-65d2-4e8a-96cb-47e011143e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.553119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319ea35-65d2-4e8a-96cb-47e011143e01 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.564058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1035/2090] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:35.565598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a561-808c-46e5-a6a9-158ab02e7166 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.565855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a561-808c-46e5-a6a9-158ab02e7166 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.566142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a561-808c-46e5-a6a9-158ab02e7166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.577404 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cbcd6-1dc8-455d-884c-5cd7b3478816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.579319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cbcd6-1dc8-455d-884c-5cd7b3478816 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.585835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9f74a561-808c-46e5-a6a9-158ab02e7166 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:35.587276 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9f74a561-808c-46e5-a6a9-158ab02e7166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:35.592469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1056/2091] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:35 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:35.593331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cbcd6-1dc8-455d-884c-5cd7b3478816 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.607913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1036/2092] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:35.608960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cbcd6-1dc8-455d-884c-5cd7b3478816 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.616163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0150-0cb3-4f4e-9da4-76ecd7b5aa4b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.616747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0150-0cb3-4f4e-9da4-76ecd7b5aa4b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.617169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0150-0cb3-4f4e-9da4-76ecd7b5aa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.620633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37655d-ba57-4dc8-946c-dd4c276070c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.621335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37655d-ba57-4dc8-946c-dd4c276070c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.621660 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37655d-ba57-4dc8-946c-dd4c276070c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.622372 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37655d-ba57-4dc8-946c-dd4c276070c2 admin admin] PATH_INFO: `/v3/projects/d71f6ed467e841e2977acc5d5b80c537/users/11ca3771fcea424aa41481c9de791773/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.641118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37655d-ba57-4dc8-946c-dd4c276070c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71f6ed467e841e2977acc5d5b80c537, user_id=11ca3771fcea424aa41481c9de791773, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.643842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37655d-ba57-4dc8-946c-dd4c276070c2 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.652872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1d7f0150-0cb3-4f4e-9da4-76ecd7b5aa4b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:35.654247 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1d7f0150-0cb3-4f4e-9da4-76ecd7b5aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:35.664344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1037/2093] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:35.670816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1057/2094] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:35 2022] PUT /identity/v3/projects/d71f6ed467e841e2977acc5d5b80c537/users/11ca3771fcea424aa41481c9de791773/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:35.671387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0150-0cb3-4f4e-9da4-76ecd7b5aa4b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.681939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f9d0-9885-4e55-8aa2-21afd4b65e93 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.682315 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f9d0-9885-4e55-8aa2-21afd4b65e93 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.682705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f9d0-9885-4e55-8aa2-21afd4b65e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.684576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0150-0cb3-4f4e-9da4-76ecd7b5aa4b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.720203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-bb97f9d0-9885-4e55-8aa2-21afd4b65e93 None None] MFA Rules not processed for user `11ca3771fcea424aa41481c9de791773`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:35.720646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:35.721612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-bb97f9d0-9885-4e55-8aa2-21afd4b65e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:35.747333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:35.770763 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca920d-a228-4a30-a346-81ad4e0416ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.771588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca920d-a228-4a30-a346-81ad4e0416ba admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.771873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca920d-a228-4a30-a346-81ad4e0416ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.772146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca920d-a228-4a30-a346-81ad4e0416ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.773352 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca920d-a228-4a30-a346-81ad4e0416ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:35.773660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca920d-a228-4a30-a346-81ad4e0416ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.776215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca920d-a228-4a30-a346-81ad4e0416ba admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.792921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1038/2095] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:35.792921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca920d-a228-4a30-a346-81ad4e0416ba admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.794365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-12ca920d-a228-4a30-a346-81ad4e0416ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:35.808455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1058/2096] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:08:35.809953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97f9d0-9885-4e55-8aa2-21afd4b65e93 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.823703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97f9d0-9885-4e55-8aa2-21afd4b65e93 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.841958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7fa20-3875-42e4-be48-56515cca208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.842637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7fa20-3875-42e4-be48-56515cca208d admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.842974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7fa20-3875-42e4-be48-56515cca208d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.843187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7fa20-3875-42e4-be48-56515cca208d admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.843891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7fa20-3875-42e4-be48-56515cca208d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.845950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7fa20-3875-42e4-be48-56515cca208d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.867211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca920d-a228-4a30-a346-81ad4e0416ba admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.875951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b1a21-e469-4208-99fb-557bccdf585a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.876638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1a21-e469-4208-99fb-557bccdf585a service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.876921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1a21-e469-4208-99fb-557bccdf585a service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.877200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b1a21-e469-4208-99fb-557bccdf585a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.879290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1059/2097] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:35 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:35.880934 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7fa20-3875-42e4-be48-56515cca208d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.883245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f88b1a21-e469-4208-99fb-557bccdf585a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:35.950069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b1a21-e469-4208-99fb-557bccdf585a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.951507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b1a21-e469-4208-99fb-557bccdf585a service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.959738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7fa20-3875-42e4-be48-56515cca208d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.964299 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1039/2098] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:35 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:35.967713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b1a21-e469-4208-99fb-557bccdf585a service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:35.974765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74633d23-c2d9-44ee-ab05-c892fe8462fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.975497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633d23-c2d9-44ee-ab05-c892fe8462fe admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.975794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633d23-c2d9-44ee-ab05-c892fe8462fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.976119 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633d23-c2d9-44ee-ab05-c892fe8462fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.976909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74633d23-c2d9-44ee-ab05-c892fe8462fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.980038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74633d23-c2d9-44ee-ab05-c892fe8462fe admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:35.981914 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b1a21-e469-4208-99fb-557bccdf585a service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:35.988259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70969b50-6928-48c3-a3e6-b68a0a98f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:35.988965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70969b50-6928-48c3-a3e6-b68a0a98f65b admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:35.989253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70969b50-6928-48c3-a3e6-b68a0a98f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:35.989533 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70969b50-6928-48c3-a3e6-b68a0a98f65b admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:35.991059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70969b50-6928-48c3-a3e6-b68a0a98f65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:35.994048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70969b50-6928-48c3-a3e6-b68a0a98f65b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.018788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1060/2099] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:35 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:36.022600 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74633d23-c2d9-44ee-ab05-c892fe8462fe admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.025507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1040/2100] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:35 2022] POST /identity/v3/users => generated 288 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:36.032061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70969b50-6928-48c3-a3e6-b68a0a98f65b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.051937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70969b50-6928-48c3-a3e6-b68a0a98f65b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.158715 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74633d23-c2d9-44ee-ab05-c892fe8462fe admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.171657 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d08d1-5fa7-4f07-8ec7-ee55f91b72af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.172497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d08d1-5fa7-4f07-8ec7-ee55f91b72af admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.172849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d08d1-5fa7-4f07-8ec7-ee55f91b72af admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.173194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d08d1-5fa7-4f07-8ec7-ee55f91b72af admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.173972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d08d1-5fa7-4f07-8ec7-ee55f91b72af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.176885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d08d1-5fa7-4f07-8ec7-ee55f91b72af admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.182081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:36.196813 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c69cb2-d3f3-45f6-8eed-bf4b237ad1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.197697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69cb2-d3f3-45f6-8eed-bf4b237ad1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.198056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69cb2-d3f3-45f6-8eed-bf4b237ad1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.198408 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c69cb2-d3f3-45f6-8eed-bf4b237ad1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.199554 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c69cb2-d3f3-45f6-8eed-bf4b237ad1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.201011 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c69cb2-d3f3-45f6-8eed-bf4b237ad1e9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.209969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1061/2101] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:36 2022] POST /identity/v3/users => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:36.211167 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d08d1-5fa7-4f07-8ec7-ee55f91b72af admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.212280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1041/2102] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:36.217021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c69cb2-d3f3-45f6-8eed-bf4b237ad1e9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.223181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d08d1-5fa7-4f07-8ec7-ee55f91b72af admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.227744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c69cb2-d3f3-45f6-8eed-bf4b237ad1e9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.227882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e8f83-3725-4a99-a0aa-c40e20a7512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.228505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8f83-3725-4a99-a0aa-c40e20a7512f admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.228854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8f83-3725-4a99-a0aa-c40e20a7512f admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.230185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8f83-3725-4a99-a0aa-c40e20a7512f admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.230402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e8f83-3725-4a99-a0aa-c40e20a7512f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.232024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e8f83-3725-4a99-a0aa-c40e20a7512f admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.240021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac98dc-155b-4b3f-8f54-bea1f238e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.247739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac98dc-155b-4b3f-8f54-bea1f238e609 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.247739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac98dc-155b-4b3f-8f54-bea1f238e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.248216 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1062/2103] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:36.251639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac98dc-155b-4b3f-8f54-bea1f238e609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.252522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac98dc-155b-4b3f-8f54-bea1f238e609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.253039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e8f83-3725-4a99-a0aa-c40e20a7512f admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.258186 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac98dc-155b-4b3f-8f54-bea1f238e609 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.260080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:36.267063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e8f83-3725-4a99-a0aa-c40e20a7512f admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.272108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1042/2104] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:36.274897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f73811-01f4-4143-a2fb-b83d766f9a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.276300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f73811-01f4-4143-a2fb-b83d766f9a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.276610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f73811-01f4-4143-a2fb-b83d766f9a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.276718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac98dc-155b-4b3f-8f54-bea1f238e609 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.276880 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f73811-01f4-4143-a2fb-b83d766f9a27 admin admin] PATH_INFO: `/v3/projects/cbe88304fd3442faa4951d8e8d5e5e2b/users/0662ad274bb14ed7a75f24113a96ceb2/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.288941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac98dc-155b-4b3f-8f54-bea1f238e609 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.294833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f73811-01f4-4143-a2fb-b83d766f9a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe88304fd3442faa4951d8e8d5e5e2b, user_id=0662ad274bb14ed7a75f24113a96ceb2, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.295523 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b682413-b714-4fc7-8510-a8da8d4d7abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.296658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682413-b714-4fc7-8510-a8da8d4d7abd admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.297084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682413-b714-4fc7-8510-a8da8d4d7abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.297372 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682413-b714-4fc7-8510-a8da8d4d7abd admin admin] PATH_INFO: `/v3/projects/5644dd829c594378a15706fa6f4fb1e2/users/bb052513cbc94496a26d2ae02c2e61d6/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.298623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f73811-01f4-4143-a2fb-b83d766f9a27 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.323660 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1063/2105] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:36 2022] PUT /identity/v3/projects/cbe88304fd3442faa4951d8e8d5e5e2b/users/0662ad274bb14ed7a75f24113a96ceb2/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:36.324215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b682413-b714-4fc7-8510-a8da8d4d7abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5644dd829c594378a15706fa6f4fb1e2, user_id=bb052513cbc94496a26d2ae02c2e61d6, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.327687 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f73811-01f4-4143-a2fb-b83d766f9a27 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.328080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b682413-b714-4fc7-8510-a8da8d4d7abd admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.345959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1043/2106] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:36 2022] PUT /identity/v3/projects/5644dd829c594378a15706fa6f4fb1e2/users/bb052513cbc94496a26d2ae02c2e61d6/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:36.356467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dc42-edc6-47eb-a8fa-0efa1b1178e2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.356976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dc42-edc6-47eb-a8fa-0efa1b1178e2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.357424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dc42-edc6-47eb-a8fa-0efa1b1178e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.391728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9837dc42-edc6-47eb-a8fa-0efa1b1178e2 None None] MFA Rules not processed for user `bb052513cbc94496a26d2ae02c2e61d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:36.392936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9837dc42-edc6-47eb-a8fa-0efa1b1178e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:36.401345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f73811-01f4-4143-a2fb-b83d766f9a27 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.466806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992048f8-6668-4f5a-a14d-6e39c2183e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.467762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992048f8-6668-4f5a-a14d-6e39c2183e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.468043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992048f8-6668-4f5a-a14d-6e39c2183e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.468437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992048f8-6668-4f5a-a14d-6e39c2183e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.469179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992048f8-6668-4f5a-a14d-6e39c2183e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.470284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1044/2107] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:08:36.470886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992048f8-6668-4f5a-a14d-6e39c2183e53 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.474746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837dc42-edc6-47eb-a8fa-0efa1b1178e2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.483685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1064/2108] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:36.487461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992048f8-6668-4f5a-a14d-6e39c2183e53 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.489781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837dc42-edc6-47eb-a8fa-0efa1b1178e2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.495906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030658b-6ab4-4ce9-91de-9c75f252cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.496916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030658b-6ab4-4ce9-91de-9c75f252cfbf admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.497220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030658b-6ab4-4ce9-91de-9c75f252cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.497639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030658b-6ab4-4ce9-91de-9c75f252cfbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.498563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030658b-6ab4-4ce9-91de-9c75f252cfbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.501676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030658b-6ab4-4ce9-91de-9c75f252cfbf admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.501807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992048f8-6668-4f5a-a14d-6e39c2183e53 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.508274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0fb96-3d85-4af0-bdbe-603965af89c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.509257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0fb96-3d85-4af0-bdbe-603965af89c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.509541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0fb96-3d85-4af0-bdbe-603965af89c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.509820 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0fb96-3d85-4af0-bdbe-603965af89c5 admin admin] PATH_INFO: `/v3/projects/cbe88304fd3442faa4951d8e8d5e5e2b/users/0662ad274bb14ed7a75f24113a96ceb2/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.512400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0fb96-3d85-4af0-bdbe-603965af89c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe88304fd3442faa4951d8e8d5e5e2b, user_id=0662ad274bb14ed7a75f24113a96ceb2, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.515088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0fb96-3d85-4af0-bdbe-603965af89c5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.536854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1065/2109] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:36 2022] PUT /identity/v3/projects/cbe88304fd3442faa4951d8e8d5e5e2b/users/0662ad274bb14ed7a75f24113a96ceb2/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:36.538800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0087c73-c509-4486-af2c-77b9a9ab4916 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.539407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1045/2110] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:36 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:08:36.540446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0087c73-c509-4486-af2c-77b9a9ab4916 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.542099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0087c73-c509-4486-af2c-77b9a9ab4916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.544083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030658b-6ab4-4ce9-91de-9c75f252cfbf admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.570419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a0087c73-c509-4486-af2c-77b9a9ab4916 None None] MFA Rules not processed for user `0662ad274bb14ed7a75f24113a96ceb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:36.571917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a0087c73-c509-4486-af2c-77b9a9ab4916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:36.614912 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030658b-6ab4-4ce9-91de-9c75f252cfbf admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.620921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15283ab-6b5d-4b3e-92ba-5e6d94fa34f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.621625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15283ab-6b5d-4b3e-92ba-5e6d94fa34f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.621910 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15283ab-6b5d-4b3e-92ba-5e6d94fa34f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.622214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15283ab-6b5d-4b3e-92ba-5e6d94fa34f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.622912 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15283ab-6b5d-4b3e-92ba-5e6d94fa34f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.625020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15283ab-6b5d-4b3e-92ba-5e6d94fa34f9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.638549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:36.652989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1046/2111] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:36 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:36.656524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1066/2112] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:08:36.656708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15283ab-6b5d-4b3e-92ba-5e6d94fa34f9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.666042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0087c73-c509-4486-af2c-77b9a9ab4916 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.668233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15283ab-6b5d-4b3e-92ba-5e6d94fa34f9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.674273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb410-4860-47c4-9611-764e43453d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.675096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb410-4860-47c4-9611-764e43453d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.675383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb410-4860-47c4-9611-764e43453d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.675659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafb410-4860-47c4-9611-764e43453d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.676412 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafb410-4860-47c4-9611-764e43453d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.678274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafb410-4860-47c4-9611-764e43453d9b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.684891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:36.694060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1047/2113] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:08:36.697940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb410-4860-47c4-9611-764e43453d9b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.709822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafb410-4860-47c4-9611-764e43453d9b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.714781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e3429-55b3-4b46-af9f-fe9580c5cf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.715453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e3429-55b3-4b46-af9f-fe9580c5cf7a admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.715736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e3429-55b3-4b46-af9f-fe9580c5cf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.716010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e3429-55b3-4b46-af9f-fe9580c5cf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.716781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e3429-55b3-4b46-af9f-fe9580c5cf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.718377 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e3429-55b3-4b46-af9f-fe9580c5cf7a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.729271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1048/2114] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:08:36.733460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e3429-55b3-4b46-af9f-fe9580c5cf7a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.736712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0087c73-c509-4486-af2c-77b9a9ab4916 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.740455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265804b5-254c-403f-8e6a-7be70df3123a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.741139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265804b5-254c-403f-8e6a-7be70df3123a service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.741554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265804b5-254c-403f-8e6a-7be70df3123a service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.741882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265804b5-254c-403f-8e6a-7be70df3123a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.749038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e3429-55b3-4b46-af9f-fe9580c5cf7a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.752212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265804b5-254c-403f-8e6a-7be70df3123a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.753702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265804b5-254c-403f-8e6a-7be70df3123a service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.754007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774f8a9-fb3a-4853-a72a-a78f3cbbed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.754879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774f8a9-fb3a-4853-a72a-a78f3cbbed11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.755166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774f8a9-fb3a-4853-a72a-a78f3cbbed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.755445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774f8a9-fb3a-4853-a72a-a78f3cbbed11 admin admin] PATH_INFO: `/v3/projects/fea20953f81f42268f6fa37f28718984/users/8fb886b43a194a2dbeb69833e89faa7b/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.768600 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1067/2115] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:36.777721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774f8a9-fb3a-4853-a72a-a78f3cbbed11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea20953f81f42268f6fa37f28718984, user_id=8fb886b43a194a2dbeb69833e89faa7b, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.780891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774f8a9-fb3a-4853-a72a-a78f3cbbed11 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.796863 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1049/2116] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:36 2022] PUT /identity/v3/projects/fea20953f81f42268f6fa37f28718984/users/8fb886b43a194a2dbeb69833e89faa7b/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:36.808359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042f9e3-ebf9-4e08-a9ab-56c5a920fc9d None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.808656 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042f9e3-ebf9-4e08-a9ab-56c5a920fc9d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.808938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042f9e3-ebf9-4e08-a9ab-56c5a920fc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.827053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774f8a9-fb3a-4853-a72a-a78f3cbbed11 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.829853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a774f8a9-fb3a-4853-a72a-a78f3cbbed11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:36.837407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-3042f9e3-ebf9-4e08-a9ab-56c5a920fc9d None None] MFA Rules not processed for user `8fb886b43a194a2dbeb69833e89faa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:36.839811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3042f9e3-ebf9-4e08-a9ab-56c5a920fc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:36.888141 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774f8a9-fb3a-4853-a72a-a78f3cbbed11 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.891853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41072b9-fcd7-4a16-a80f-c493b0faf584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.892531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41072b9-fcd7-4a16-a80f-c493b0faf584 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.892817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41072b9-fcd7-4a16-a80f-c493b0faf584 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.893105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41072b9-fcd7-4a16-a80f-c493b0faf584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.905956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1068/2117] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:36.910404 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042f9e3-ebf9-4e08-a9ab-56c5a920fc9d None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:36.949986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41072b9-fcd7-4a16-a80f-c493b0faf584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.951558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41072b9-fcd7-4a16-a80f-c493b0faf584 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:36.960933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1050/2118] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:08:36.971938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042f9e3-ebf9-4e08-a9ab-56c5a920fc9d None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:36.976667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecd5ad-31f0-4ab5-88d6-435b895a0b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:36.977315 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd5ad-31f0-4ab5-88d6-435b895a0b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:36.977689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd5ad-31f0-4ab5-88d6-435b895a0b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:36.977973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecd5ad-31f0-4ab5-88d6-435b895a0b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:36.978663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecd5ad-31f0-4ab5-88d6-435b895a0b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:36.981221 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecd5ad-31f0-4ab5-88d6-435b895a0b2d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:37.009968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1069/2119] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:36 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:08:37.011169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41072b9-fcd7-4a16-a80f-c493b0faf584 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:37.022470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41072b9-fcd7-4a16-a80f-c493b0faf584 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:37.082576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397c1fa-abc6-478d-9b03-6763a7e7646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:37.083248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397c1fa-abc6-478d-9b03-6763a7e7646b admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:37.083693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397c1fa-abc6-478d-9b03-6763a7e7646b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:37.084029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397c1fa-abc6-478d-9b03-6763a7e7646b admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:37.084771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397c1fa-abc6-478d-9b03-6763a7e7646b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:37.087178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397c1fa-abc6-478d-9b03-6763a7e7646b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:37.115346 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1051/2120] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:37 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:08:37.116589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecd5ad-31f0-4ab5-88d6-435b895a0b2d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:37.127308 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecd5ad-31f0-4ab5-88d6-435b895a0b2d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:37.132947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8116331-6443-40cc-8198-5a425adb1400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:37.133802 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8116331-6443-40cc-8198-5a425adb1400 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:37.134092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8116331-6443-40cc-8198-5a425adb1400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:37.134365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8116331-6443-40cc-8198-5a425adb1400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:37.135171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8116331-6443-40cc-8198-5a425adb1400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:37.136803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8116331-6443-40cc-8198-5a425adb1400 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:37.143082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:37.154742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397c1fa-abc6-478d-9b03-6763a7e7646b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:37.155305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1070/2121] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:37.165318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397c1fa-abc6-478d-9b03-6763a7e7646b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:37.171106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5d489-95d6-47f5-93fb-47196ab8fe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:37.171991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5d489-95d6-47f5-93fb-47196ab8fe1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:37.172270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5d489-95d6-47f5-93fb-47196ab8fe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:37.172576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5d489-95d6-47f5-93fb-47196ab8fe1f admin admin] PATH_INFO: `/v3/projects/4616aceae32140bd9cf47c1b6c6a148a/users/899c87e21e2a459197486b69c0c3db6b/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:37.178092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:37.212425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5d489-95d6-47f5-93fb-47196ab8fe1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4616aceae32140bd9cf47c1b6c6a148a, user_id=899c87e21e2a459197486b69c0c3db6b, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:37.215814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5d489-95d6-47f5-93fb-47196ab8fe1f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:37.254158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1052/2122] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:37 2022] PUT /identity/v3/projects/4616aceae32140bd9cf47c1b6c6a148a/users/899c87e21e2a459197486b69c0c3db6b/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:37.258226 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8116331-6443-40cc-8198-5a425adb1400 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:37.274706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8116331-6443-40cc-8198-5a425adb1400 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:37.358218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2cdab-6d16-4bbe-b9ab-50f55062c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:37.358875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2cdab-6d16-4bbe-b9ab-50f55062c61b admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:37.359188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2cdab-6d16-4bbe-b9ab-50f55062c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:37.359465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2cdab-6d16-4bbe-b9ab-50f55062c61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:37.361234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2cdab-6d16-4bbe-b9ab-50f55062c61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:37.363534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2cdab-6d16-4bbe-b9ab-50f55062c61b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:37.378862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1071/2123] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:08:37.382962 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5d489-95d6-47f5-93fb-47196ab8fe1f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:37.399927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5d489-95d6-47f5-93fb-47196ab8fe1f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:37.405151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257741a5-f280-4359-8e3e-065879cf1bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:37.406048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257741a5-f280-4359-8e3e-065879cf1bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:37.406332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257741a5-f280-4359-8e3e-065879cf1bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:37.406603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257741a5-f280-4359-8e3e-065879cf1bce admin admin] PATH_INFO: `/v3/projects/4616aceae32140bd9cf47c1b6c6a148a/users/899c87e21e2a459197486b69c0c3db6b/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:37.408700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257741a5-f280-4359-8e3e-065879cf1bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4616aceae32140bd9cf47c1b6c6a148a, user_id=899c87e21e2a459197486b69c0c3db6b, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:37.411545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257741a5-f280-4359-8e3e-065879cf1bce admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:37.425383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1053/2124] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:37 2022] PUT /identity/v3/projects/4616aceae32140bd9cf47c1b6c6a148a/users/899c87e21e2a459197486b69c0c3db6b/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:37.436066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1693-dad5-4821-a104-4119f547089e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:37.436396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1693-dad5-4821-a104-4119f547089e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:37.436798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1693-dad5-4821-a104-4119f547089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:37.465868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a51e1693-dad5-4821-a104-4119f547089e None None] MFA Rules not processed for user `899c87e21e2a459197486b69c0c3db6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:37.467400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a51e1693-dad5-4821-a104-4119f547089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:37.536162 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1072/2125] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:37.547478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257741a5-f280-4359-8e3e-065879cf1bce admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:37.601229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257741a5-f280-4359-8e3e-065879cf1bce admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:37.604854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c78fd-fc39-4c08-ad4e-631481a0f474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:37.605762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c78fd-fc39-4c08-ad4e-631481a0f474 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:37.606047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c78fd-fc39-4c08-ad4e-631481a0f474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:37.606322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c78fd-fc39-4c08-ad4e-631481a0f474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:37.661968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c78fd-fc39-4c08-ad4e-631481a0f474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:37.663363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c78fd-fc39-4c08-ad4e-631481a0f474 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:37.673335 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1054/2126] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:38.543763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1693-dad5-4821-a104-4119f547089e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:38.550350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a51e1693-dad5-4821-a104-4119f547089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:38.637811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1693-dad5-4821-a104-4119f547089e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:38.642405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:38.643389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:38.643563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:38.643843 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] PATH_INFO: `/v3/users/32dc34f2356a405992b9130ba6df7335` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:38.645674 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] RBAC: Authorizing `identity:delete_user(user_id=32dc34f2356a405992b9130ba6df7335)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:38.647304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:38.671673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:38.705134 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32dc34f2356a405992b9130ba6df7335'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:38.715353 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32dc34f2356a405992b9130ba6df7335'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:38.716517 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32dc34f2356a405992b9130ba6df7335'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:38.717139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32dc34f2356a405992b9130ba6df7335'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:38.734252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32dc34f2356a405992b9130ba6df7335'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:38.750032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1073/2127] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:38 2022] DELETE /identity/v3/users/32dc34f2356a405992b9130ba6df7335 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:38.755349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea0163-d0d7-4d13-aa10-92df7b177721 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:38.755865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea0163-d0d7-4d13-aa10-92df7b177721 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:38.755965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea0163-d0d7-4d13-aa10-92df7b177721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:38.775916 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8aea0163-d0d7-4d13-aa10-92df7b177721 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:38.777195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8aea0163-d0d7-4d13-aa10-92df7b177721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:38.879562 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1055/2128] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:38.890831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:38.892952 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:38.968514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe02d9-1759-409b-a7c6-0bc65840fadc admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:38.973532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f25e1b-cf13-4b08-8b05-997b05570d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:38.974485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25e1b-cf13-4b08-8b05-997b05570d5e service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:38.974686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25e1b-cf13-4b08-8b05-997b05570d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:38.974860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f25e1b-cf13-4b08-8b05-997b05570d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:38.985734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f25e1b-cf13-4b08-8b05-997b05570d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:38.987182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f25e1b-cf13-4b08-8b05-997b05570d5e service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:38.998582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1074/2129] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:39.267583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea0163-d0d7-4d13-aa10-92df7b177721 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:39.269038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8aea0163-d0d7-4d13-aa10-92df7b177721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:39.340691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:39.381937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f25e1b-cf13-4b08-8b05-997b05570d5e service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:39.384077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-63f25e1b-cf13-4b08-8b05-997b05570d5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:39.384431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea0163-d0d7-4d13-aa10-92df7b177721 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:39.388803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6f53f-8806-494f-91d6-65d3fb35d2e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:39.392415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6f53f-8806-494f-91d6-65d3fb35d2e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:39.393234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6f53f-8806-494f-91d6-65d3fb35d2e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:39.393747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6f53f-8806-494f-91d6-65d3fb35d2e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:39.397926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-36c6f53f-8806-494f-91d6-65d3fb35d2e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:39.398649 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f25e1b-cf13-4b08-8b05-997b05570d5e service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:39.403974 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:39.404945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:39.405312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:39.405672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] PATH_INFO: `/v3/projects/785a5e2316994c6296dc0083ab0f7ec7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:39.406964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=785a5e2316994c6296dc0083ab0f7ec7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:39.409102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:39.464803 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6f53f-8806-494f-91d6-65d3fb35d2e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:39.466608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6f53f-8806-494f-91d6-65d3fb35d2e1 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:39.468261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '785a5e2316994c6296dc0083ab0f7ec7', 'request_id': 'req-602921ee-82d3-4522-8b87-e20266057c9c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:39.478110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '785a5e2316994c6296dc0083ab0f7ec7', 'request_id': 'req-602921ee-82d3-4522-8b87-e20266057c9c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:39.479389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1056/2130] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:39.487063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '785a5e2316994c6296dc0083ab0f7ec7', 'request_id': 'req-602921ee-82d3-4522-8b87-e20266057c9c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:39.502819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] The token cache is being invalidate because project 785a5e2316994c6296dc0083ab0f7ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:39.503253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:39.503892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:39.506007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1075/2131] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:39 2022] DELETE /identity/v3/projects/785a5e2316994c6296dc0083ab0f7ec7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:40.118967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6f53f-8806-494f-91d6-65d3fb35d2e1 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:40.127620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6f53f-8806-494f-91d6-65d3fb35d2e1 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:40.184036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d9fdd-0ea2-4dcc-a9ff-470067514063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:40.184808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9fdd-0ea2-4dcc-a9ff-470067514063 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:40.185190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9fdd-0ea2-4dcc-a9ff-470067514063 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:40.185537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d9fdd-0ea2-4dcc-a9ff-470067514063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:40.187399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fa0d9fdd-0ea2-4dcc-a9ff-470067514063 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:40.261580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d9fdd-0ea2-4dcc-a9ff-470067514063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:40.263358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d9fdd-0ea2-4dcc-a9ff-470067514063 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:40.273670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1057/2132] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:40.575882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:40.577433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:40.610565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:40.653221 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602921ee-82d3-4522-8b87-e20266057c9c admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:40.658525 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:40.659666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:40.659955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:40.660233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] PATH_INFO: `/v3/users/11ca3771fcea424aa41481c9de791773` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:40.661460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ca3771fcea424aa41481c9de791773)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:40.663399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:40.712711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ca3771fcea424aa41481c9de791773'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:40.720564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ca3771fcea424aa41481c9de791773'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:40.721245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ca3771fcea424aa41481c9de791773'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:40.721984 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ca3771fcea424aa41481c9de791773'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:40.735301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ca3771fcea424aa41481c9de791773'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:40.748434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1076/2133] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:40 2022] DELETE /identity/v3/users/11ca3771fcea424aa41481c9de791773 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:40.752937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e210-fb1d-438c-a5b0-21b8508f0c95 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:40.753271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e210-fb1d-438c-a5b0-21b8508f0c95 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:40.753551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7e210-fb1d-438c-a5b0-21b8508f0c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:40.770172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-44e7e210-fb1d-438c-a5b0-21b8508f0c95 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:40.771704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-44e7e210-fb1d-438c-a5b0-21b8508f0c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:40.799596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:40.839402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1058/2134] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:40.849735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:40.851375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:40.914805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc51abc-d6d9-42bd-873e-9bf5159ec953 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:40.919253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573f3ff-1f3c-4de1-9d00-77982085910e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:40.919900 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573f3ff-1f3c-4de1-9d00-77982085910e service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:40.920185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573f3ff-1f3c-4de1-9d00-77982085910e service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:40.920504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573f3ff-1f3c-4de1-9d00-77982085910e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:40.930718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573f3ff-1f3c-4de1-9d00-77982085910e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:40.932192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573f3ff-1f3c-4de1-9d00-77982085910e service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:40.943147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1077/2135] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:41.222269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7e210-fb1d-438c-a5b0-21b8508f0c95 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:41.223801 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-44e7e210-fb1d-438c-a5b0-21b8508f0c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:41.236975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7e210-fb1d-438c-a5b0-21b8508f0c95 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:41.242866 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:41.243869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:41.244189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:41.244622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] PATH_INFO: `/v3/projects/d71f6ed467e841e2977acc5d5b80c537` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:41.245852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71f6ed467e841e2977acc5d5b80c537)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:41.248049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:41.301126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71f6ed467e841e2977acc5d5b80c537', 'request_id': 'req-5f7b408a-b252-4706-b094-5f9bf605545d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:41.307808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71f6ed467e841e2977acc5d5b80c537', 'request_id': 'req-5f7b408a-b252-4706-b094-5f9bf605545d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:41.314670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71f6ed467e841e2977acc5d5b80c537', 'request_id': 'req-5f7b408a-b252-4706-b094-5f9bf605545d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:41.326815 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] The token cache is being invalidate because project d71f6ed467e841e2977acc5d5b80c537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:41.327101 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:41.327751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:41.329395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1059/2136] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:41 2022] DELETE /identity/v3/projects/d71f6ed467e841e2977acc5d5b80c537 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:41.333390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573f3ff-1f3c-4de1-9d00-77982085910e service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:41.343131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573f3ff-1f3c-4de1-9d00-77982085910e service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:41.391818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:41.406490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa830ff6-8ee9-433b-a18c-a1c064c1f844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:41.407824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa830ff6-8ee9-433b-a18c-a1c064c1f844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:41.408205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa830ff6-8ee9-433b-a18c-a1c064c1f844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:41.408639 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa830ff6-8ee9-433b-a18c-a1c064c1f844 admin admin] PATH_INFO: `/v3/users/0662ad274bb14ed7a75f24113a96ceb2` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:41.410127 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa830ff6-8ee9-433b-a18c-a1c064c1f844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0662ad274bb14ed7a75f24113a96ceb2)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:41.415220 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa830ff6-8ee9-433b-a18c-a1c064c1f844 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:41.483445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-aa830ff6-8ee9-433b-a18c-a1c064c1f844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0662ad274bb14ed7a75f24113a96ceb2'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:41.492913 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-aa830ff6-8ee9-433b-a18c-a1c064c1f844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0662ad274bb14ed7a75f24113a96ceb2'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:41.493705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-aa830ff6-8ee9-433b-a18c-a1c064c1f844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0662ad274bb14ed7a75f24113a96ceb2'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:41.495207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-aa830ff6-8ee9-433b-a18c-a1c064c1f844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0662ad274bb14ed7a75f24113a96ceb2'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:41.510999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-aa830ff6-8ee9-433b-a18c-a1c064c1f844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0662ad274bb14ed7a75f24113a96ceb2'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:41.531689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1078/2137] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:41 2022] DELETE /identity/v3/users/0662ad274bb14ed7a75f24113a96ceb2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:41.938002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:41.939509 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:41.953341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b408a-b252-4706-b094-5f9bf605545d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:42.015669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:42.017619 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:42.018054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:42.018321 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] PATH_INFO: `/v3/projects/cbe88304fd3442faa4951d8e8d5e5e2b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:42.019551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe88304fd3442faa4951d8e8d5e5e2b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:42.021938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:42.073850 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe88304fd3442faa4951d8e8d5e5e2b', 'request_id': 'req-6c585c99-c944-4423-a7cd-2f90a272cc83'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:42.078846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:42.079827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe88304fd3442faa4951d8e8d5e5e2b', 'request_id': 'req-6c585c99-c944-4423-a7cd-2f90a272cc83'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:42.089174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe88304fd3442faa4951d8e8d5e5e2b', 'request_id': 'req-6c585c99-c944-4423-a7cd-2f90a272cc83'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:42.101396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] The token cache is being invalidate because project cbe88304fd3442faa4951d8e8d5e5e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:42.101686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:42.102338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-6c585c99-c944-4423-a7cd-2f90a272cc83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:42.104702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1060/2138] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:41 2022] DELETE /identity/v3/projects/cbe88304fd3442faa4951d8e8d5e5e2b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:42.110071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba14a3-7708-4480-8d52-da672fd96808 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:42.110560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba14a3-7708-4480-8d52-da672fd96808 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:42.110857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba14a3-7708-4480-8d52-da672fd96808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:42.128918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-f2ba14a3-7708-4480-8d52-da672fd96808 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:42.130268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f2ba14a3-7708-4480-8d52-da672fd96808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:42.195559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1079/2139] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:42.203724 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a565a-1821-474b-b048-f4b711a00e85 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:42.204012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a565a-1821-474b-b048-f4b711a00e85 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:42.204289 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a565a-1821-474b-b048-f4b711a00e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:42.222181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b94a565a-1821-474b-b048-f4b711a00e85 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:42.223390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b94a565a-1821-474b-b048-f4b711a00e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:42.231360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1061/2140] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:42.235669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba14a3-7708-4480-8d52-da672fd96808 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:42.246937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba14a3-7708-4480-8d52-da672fd96808 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:42.251906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9249c58-bb3f-42f9-9d62-ff012e48fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:42.252595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9249c58-bb3f-42f9-9d62-ff012e48fea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:42.252886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9249c58-bb3f-42f9-9d62-ff012e48fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:42.253189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9249c58-bb3f-42f9-9d62-ff012e48fea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:42.253921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9249c58-bb3f-42f9-9d62-ff012e48fea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:42.254230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9249c58-bb3f-42f9-9d62-ff012e48fea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:42.255849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9249c58-bb3f-42f9-9d62-ff012e48fea0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:42.268083 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1080/2141] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:42.272669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a565a-1821-474b-b048-f4b711a00e85 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:42.281873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a565a-1821-474b-b048-f4b711a00e85 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:42.286636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996b1c8-815d-4284-8232-d33152330e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:42.287288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996b1c8-815d-4284-8232-d33152330e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:42.287572 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996b1c8-815d-4284-8232-d33152330e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:42.287852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996b1c8-815d-4284-8232-d33152330e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:42.288577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996b1c8-815d-4284-8232-d33152330e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:42.290493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996b1c8-815d-4284-8232-d33152330e0a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:42.315937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1062/2142] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:42 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:42.320355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9249c58-bb3f-42f9-9d62-ff012e48fea0 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:42.333303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9249c58-bb3f-42f9-9d62-ff012e48fea0 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:42.382749 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:42.392435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31381afe-5881-4551-92ac-ce61c511cbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:42.393117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381afe-5881-4551-92ac-ce61c511cbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:42.393410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381afe-5881-4551-92ac-ce61c511cbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:42.393695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381afe-5881-4551-92ac-ce61c511cbe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:42.394477 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31381afe-5881-4551-92ac-ce61c511cbe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:42.396721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31381afe-5881-4551-92ac-ce61c511cbe9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:42.416278 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1081/2143] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:42 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:42.420337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996b1c8-815d-4284-8232-d33152330e0a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:42.432137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996b1c8-815d-4284-8232-d33152330e0a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:42.436870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c858dac-6f2c-4e15-aee8-8b7b67c548dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:42.437524 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c858dac-6f2c-4e15-aee8-8b7b67c548dd admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:42.437808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c858dac-6f2c-4e15-aee8-8b7b67c548dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:42.438089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c858dac-6f2c-4e15-aee8-8b7b67c548dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:42.438815 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c858dac-6f2c-4e15-aee8-8b7b67c548dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:42.440468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c858dac-6f2c-4e15-aee8-8b7b67c548dd admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:42.451425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1063/2144] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:42.455491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31381afe-5881-4551-92ac-ce61c511cbe9 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:42.465638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31381afe-5881-4551-92ac-ce61c511cbe9 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:42.470230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9761585-73d4-4e5d-9ef1-a87b432d0386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:42.470904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9761585-73d4-4e5d-9ef1-a87b432d0386 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:42.471195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9761585-73d4-4e5d-9ef1-a87b432d0386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:42.471498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9761585-73d4-4e5d-9ef1-a87b432d0386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:42.472227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9761585-73d4-4e5d-9ef1-a87b432d0386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:42.473862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9761585-73d4-4e5d-9ef1-a87b432d0386 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:42.484285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1082/2145] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:42.488375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c858dac-6f2c-4e15-aee8-8b7b67c548dd admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:42.499013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c858dac-6f2c-4e15-aee8-8b7b67c548dd admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:42.503624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b901c4-cdd9-48d4-b4eb-1ad1e3f9c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:42.504524 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b901c4-cdd9-48d4-b4eb-1ad1e3f9c02e admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:42.504808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b901c4-cdd9-48d4-b4eb-1ad1e3f9c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:42.505083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b901c4-cdd9-48d4-b4eb-1ad1e3f9c02e admin admin] PATH_INFO: `/v3/projects/b0b4eaefba9040b7a54e3a6917e4bfe1/users/cd9b0488ff9c4f2bb1a50916b205ba11/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:42.519097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b901c4-cdd9-48d4-b4eb-1ad1e3f9c02e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b4eaefba9040b7a54e3a6917e4bfe1, user_id=cd9b0488ff9c4f2bb1a50916b205ba11, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:42.522063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b901c4-cdd9-48d4-b4eb-1ad1e3f9c02e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:42.534424 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1064/2146] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:42 2022] PUT /identity/v3/projects/b0b4eaefba9040b7a54e3a6917e4bfe1/users/cd9b0488ff9c4f2bb1a50916b205ba11/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:42.539420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eda4c-8443-475d-9bc6-c9b5f8d1e2c6 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:42.539713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eda4c-8443-475d-9bc6-c9b5f8d1e2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:42.540021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eda4c-8443-475d-9bc6-c9b5f8d1e2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:42.558808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-3e6eda4c-8443-475d-9bc6-c9b5f8d1e2c6 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:42.560005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3e6eda4c-8443-475d-9bc6-c9b5f8d1e2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:42.616987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1083/2147] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:42.627583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b901c4-cdd9-48d4-b4eb-1ad1e3f9c02e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:42.629264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-12b901c4-cdd9-48d4-b4eb-1ad1e3f9c02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:42.686184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b901c4-cdd9-48d4-b4eb-1ad1e3f9c02e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:42.689800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e383dc-f202-4c00-b955-ed27b6183a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:42.690433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e383dc-f202-4c00-b955-ed27b6183a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:42.690715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e383dc-f202-4c00-b955-ed27b6183a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:42.690988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e383dc-f202-4c00-b955-ed27b6183a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:42.699932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e383dc-f202-4c00-b955-ed27b6183a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:42.701387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e383dc-f202-4c00-b955-ed27b6183a86 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:42.710770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1065/2148] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:43.487694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4927-eb22-4feb-a0d6-c08f30c78331 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:43.488255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4927-eb22-4feb-a0d6-c08f30c78331 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:43.488584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c4927-eb22-4feb-a0d6-c08f30c78331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:43.517006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-ac3c4927-eb22-4feb-a0d6-c08f30c78331 None None] MFA Rules not processed for user `cd9b0488ff9c4f2bb1a50916b205ba11`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:43.518482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ac3c4927-eb22-4feb-a0d6-c08f30c78331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:43.590195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1084/2149] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:43.594790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e383dc-f202-4c00-b955-ed27b6183a86 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:43.605201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e383dc-f202-4c00-b955-ed27b6183a86 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:43.610563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780b0fc-de7b-4fcc-83cd-ae44e8e9bc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:43.611224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b0fc-de7b-4fcc-83cd-ae44e8e9bc8a admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:43.611510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b0fc-de7b-4fcc-83cd-ae44e8e9bc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:43.611792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b0fc-de7b-4fcc-83cd-ae44e8e9bc8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:43.612536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780b0fc-de7b-4fcc-83cd-ae44e8e9bc8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:43.614712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780b0fc-de7b-4fcc-83cd-ae44e8e9bc8a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:43.642182 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1066/2150] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:43 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:43.646489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c4927-eb22-4feb-a0d6-c08f30c78331 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:43.658720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c4927-eb22-4feb-a0d6-c08f30c78331 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:43.715611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd416b-9e8c-4fb1-b3e7-95e3e974f55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:43.716284 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd416b-9e8c-4fb1-b3e7-95e3e974f55d admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:43.716604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd416b-9e8c-4fb1-b3e7-95e3e974f55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:43.716888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd416b-9e8c-4fb1-b3e7-95e3e974f55d admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:43.717592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd416b-9e8c-4fb1-b3e7-95e3e974f55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:43.719513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd416b-9e8c-4fb1-b3e7-95e3e974f55d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:43.727889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:43.740122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1085/2151] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:43 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:08:43.744108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780b0fc-de7b-4fcc-83cd-ae44e8e9bc8a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:43.755192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780b0fc-de7b-4fcc-83cd-ae44e8e9bc8a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:43.761066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a09ba5-3d9e-4bd1-9b41-5468c797ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:43.761721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a09ba5-3d9e-4bd1-9b41-5468c797ba70 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:43.762006 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a09ba5-3d9e-4bd1-9b41-5468c797ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:43.762281 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a09ba5-3d9e-4bd1-9b41-5468c797ba70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:43.763000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a09ba5-3d9e-4bd1-9b41-5468c797ba70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:43.764642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a09ba5-3d9e-4bd1-9b41-5468c797ba70 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:43.776617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1067/2152] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:43.781400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd416b-9e8c-4fb1-b3e7-95e3e974f55d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:43.792698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd416b-9e8c-4fb1-b3e7-95e3e974f55d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:43.797890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69641eea-cb22-4cf4-ba20-26bba38fa51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:43.798816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69641eea-cb22-4cf4-ba20-26bba38fa51c admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:43.799105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69641eea-cb22-4cf4-ba20-26bba38fa51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:43.799384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69641eea-cb22-4cf4-ba20-26bba38fa51c admin admin] PATH_INFO: `/v3/projects/4ebdddd165234b368ab5f197b6968e14/users/afe657c1b0954523a4720ff3170cdce9/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:43.814966 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69641eea-cb22-4cf4-ba20-26bba38fa51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebdddd165234b368ab5f197b6968e14, user_id=afe657c1b0954523a4720ff3170cdce9, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:43.818794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69641eea-cb22-4cf4-ba20-26bba38fa51c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:43.832340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1086/2153] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:43 2022] PUT /identity/v3/projects/4ebdddd165234b368ab5f197b6968e14/users/afe657c1b0954523a4720ff3170cdce9/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:43.836341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a09ba5-3d9e-4bd1-9b41-5468c797ba70 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:43.847098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a09ba5-3d9e-4bd1-9b41-5468c797ba70 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:43.895098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:43.906668 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6a16d-2c59-4ff8-94b2-e88c142d90c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:43.907338 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6a16d-2c59-4ff8-94b2-e88c142d90c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:43.907626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6a16d-2c59-4ff8-94b2-e88c142d90c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:43.907904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6a16d-2c59-4ff8-94b2-e88c142d90c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:43.908662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6a16d-2c59-4ff8-94b2-e88c142d90c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:43.910314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6a16d-2c59-4ff8-94b2-e88c142d90c7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:43.920651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1068/2154] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:43.924743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69641eea-cb22-4cf4-ba20-26bba38fa51c admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:43.935132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69641eea-cb22-4cf4-ba20-26bba38fa51c admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:43.939721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f29e2c-4c9b-4ffd-b9c8-3dff2d31c43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:43.940630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29e2c-4c9b-4ffd-b9c8-3dff2d31c43c admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:43.940918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29e2c-4c9b-4ffd-b9c8-3dff2d31c43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:43.941194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29e2c-4c9b-4ffd-b9c8-3dff2d31c43c admin admin] PATH_INFO: `/v3/projects/4ebdddd165234b368ab5f197b6968e14/users/afe657c1b0954523a4720ff3170cdce9/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:43.943160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f29e2c-4c9b-4ffd-b9c8-3dff2d31c43c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebdddd165234b368ab5f197b6968e14, user_id=afe657c1b0954523a4720ff3170cdce9, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:43.945880 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f29e2c-4c9b-4ffd-b9c8-3dff2d31c43c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:43.956661 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1087/2155] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:43 2022] PUT /identity/v3/projects/4ebdddd165234b368ab5f197b6968e14/users/afe657c1b0954523a4720ff3170cdce9/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:44.359269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6a16d-2c59-4ff8-94b2-e88c142d90c7 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:44.361782 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-68a6a16d-2c59-4ff8-94b2-e88c142d90c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:44.374817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6a16d-2c59-4ff8-94b2-e88c142d90c7 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:44.443046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f2369-ea27-4921-be28-0ec38e19f31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:44.444099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f2369-ea27-4921-be28-0ec38e19f31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:44.444405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f2369-ea27-4921-be28-0ec38e19f31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:44.445281 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f2369-ea27-4921-be28-0ec38e19f31a admin admin] PATH_INFO: `/v3/users/bb052513cbc94496a26d2ae02c2e61d6` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:44.446177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f2369-ea27-4921-be28-0ec38e19f31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb052513cbc94496a26d2ae02c2e61d6)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:44.449154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f2369-ea27-4921-be28-0ec38e19f31a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:44.517453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-221f2369-ea27-4921-be28-0ec38e19f31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb052513cbc94496a26d2ae02c2e61d6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:44.518417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-221f2369-ea27-4921-be28-0ec38e19f31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb052513cbc94496a26d2ae02c2e61d6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:44.528238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-221f2369-ea27-4921-be28-0ec38e19f31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb052513cbc94496a26d2ae02c2e61d6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:44.542225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-221f2369-ea27-4921-be28-0ec38e19f31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb052513cbc94496a26d2ae02c2e61d6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:44.544721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-221f2369-ea27-4921-be28-0ec38e19f31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb052513cbc94496a26d2ae02c2e61d6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:44.581071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1069/2156] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:44 2022] DELETE /identity/v3/users/bb052513cbc94496a26d2ae02c2e61d6 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:44.586904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda19c1-d279-40b6-b33e-31e2f0cb9e79 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:44.587353 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda19c1-d279-40b6-b33e-31e2f0cb9e79 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:44.587452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda19c1-d279-40b6-b33e-31e2f0cb9e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:44.612836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-bbda19c1-d279-40b6-b33e-31e2f0cb9e79 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:44.614337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-bbda19c1-d279-40b6-b33e-31e2f0cb9e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:44.640215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff9903-e903-4a3e-9c30-559fda5345cc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:44.641436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff9903-e903-4a3e-9c30-559fda5345cc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:44.642729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff9903-e903-4a3e-9c30-559fda5345cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:44.688008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-95ff9903-e903-4a3e-9c30-559fda5345cc None None] MFA Rules not processed for user `afe657c1b0954523a4720ff3170cdce9`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:44.690167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-95ff9903-e903-4a3e-9c30-559fda5345cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:44.709019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1088/2157] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:44.719045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda19c1-d279-40b6-b33e-31e2f0cb9e79 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:44.721390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-bbda19c1-d279-40b6-b33e-31e2f0cb9e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:44.771394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:44.814758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda19c1-d279-40b6-b33e-31e2f0cb9e79 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:44.818887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1070/2158] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:44.819032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9021c5a-521c-441e-9e29-3fca97d00244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:44.819787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021c5a-521c-441e-9e29-3fca97d00244 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:44.820175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021c5a-521c-441e-9e29-3fca97d00244 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:44.820589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021c5a-521c-441e-9e29-3fca97d00244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:44.831759 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa750226-205e-4d99-8a60-7c4b87d55d1f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:44.832269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa750226-205e-4d99-8a60-7c4b87d55d1f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:44.832739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa750226-205e-4d99-8a60-7c4b87d55d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:44.834124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9021c5a-521c-441e-9e29-3fca97d00244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:44.835711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9021c5a-521c-441e-9e29-3fca97d00244 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:44.847905 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1089/2159] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:44.858585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fa750226-205e-4d99-8a60-7c4b87d55d1f None None] MFA Rules not processed for user `cd9b0488ff9c4f2bb1a50916b205ba11`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:44.859925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fa750226-205e-4d99-8a60-7c4b87d55d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:45.018112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1071/2160] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:45.019253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9021c5a-521c-441e-9e29-3fca97d00244 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:45.021505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c9021c5a-521c-441e-9e29-3fca97d00244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:45.118388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:45.137269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9021c5a-521c-441e-9e29-3fca97d00244 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:45.142919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefcd09-b7d7-4520-9900-8506b0e0a6d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:45.143570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefcd09-b7d7-4520-9900-8506b0e0a6d1 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:45.143854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefcd09-b7d7-4520-9900-8506b0e0a6d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:45.144445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefcd09-b7d7-4520-9900-8506b0e0a6d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:45.146355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9eefcd09-b7d7-4520-9900-8506b0e0a6d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:45.157076 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefcd09-b7d7-4520-9900-8506b0e0a6d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:45.158749 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eefcd09-b7d7-4520-9900-8506b0e0a6d1 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:45.167927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1090/2161] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:08:45.201954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa750226-205e-4d99-8a60-7c4b87d55d1f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:45.204202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fa750226-205e-4d99-8a60-7c4b87d55d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:45.220572 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa750226-205e-4d99-8a60-7c4b87d55d1f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:45.232573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:45.233587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:45.233972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:45.234361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] PATH_INFO: `/v3/projects/5644dd829c594378a15706fa6f4fb1e2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:45.235695 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5644dd829c594378a15706fa6f4fb1e2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:45.238552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:45.289217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5644dd829c594378a15706fa6f4fb1e2', 'request_id': 'req-22594411-d198-4b33-a0e7-26d2406a041a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.294891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5644dd829c594378a15706fa6f4fb1e2', 'request_id': 'req-22594411-d198-4b33-a0e7-26d2406a041a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.302417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5644dd829c594378a15706fa6f4fb1e2', 'request_id': 'req-22594411-d198-4b33-a0e7-26d2406a041a'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.323014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] The token cache is being invalidate because project 5644dd829c594378a15706fa6f4fb1e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:45.323244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.323971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.325938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1072/2162] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:45 2022] DELETE /identity/v3/projects/5644dd829c594378a15706fa6f4fb1e2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:45.329726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefcd09-b7d7-4520-9900-8506b0e0a6d1 service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:45.340665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eefcd09-b7d7-4520-9900-8506b0e0a6d1 service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:45.401841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:45.402718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:45.403003 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:45.403276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] PATH_INFO: `/v3/users/8fb886b43a194a2dbeb69833e89faa7b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:45.404523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb886b43a194a2dbeb69833e89faa7b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:45.406724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:45.456505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb886b43a194a2dbeb69833e89faa7b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.470564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb886b43a194a2dbeb69833e89faa7b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.471530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb886b43a194a2dbeb69833e89faa7b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.472239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb886b43a194a2dbeb69833e89faa7b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.486571 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb886b43a194a2dbeb69833e89faa7b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.502820 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1091/2163] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:45 2022] DELETE /identity/v3/users/8fb886b43a194a2dbeb69833e89faa7b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:45.800440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:45.802639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:45.824660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22594411-d198-4b33-a0e7-26d2406a041a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:45.900791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:45.901807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:45.902091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:45.902407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] PATH_INFO: `/v3/projects/fea20953f81f42268f6fa37f28718984` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:45.903631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea20953f81f42268f6fa37f28718984)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:45.905656 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:45.936061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:45.967917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea20953f81f42268f6fa37f28718984', 'request_id': 'req-72d7e451-bb4f-4635-be48-78501f17ba23'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.973672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea20953f81f42268f6fa37f28718984', 'request_id': 'req-72d7e451-bb4f-4635-be48-78501f17ba23'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.982243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea20953f81f42268f6fa37f28718984', 'request_id': 'req-72d7e451-bb4f-4635-be48-78501f17ba23'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.996552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] The token cache is being invalidate because project fea20953f81f42268f6fa37f28718984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:45.996851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.997603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:45.999183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1073/2164] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:45 2022] DELETE /identity/v3/projects/fea20953f81f42268f6fa37f28718984 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:46.003272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:46.004892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:46.018879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74c75c-fc86-4f99-ad97-9f160ae24bf9 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:46.083917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702da864-3fd9-4a42-88ce-543cea61379e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:46.084977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702da864-3fd9-4a42-88ce-543cea61379e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:46.085273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702da864-3fd9-4a42-88ce-543cea61379e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:46.085723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702da864-3fd9-4a42-88ce-543cea61379e admin admin] PATH_INFO: `/v3/users/899c87e21e2a459197486b69c0c3db6b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:46.086932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702da864-3fd9-4a42-88ce-543cea61379e admin admin] RBAC: Authorizing `identity:delete_user(user_id=899c87e21e2a459197486b69c0c3db6b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:46.089502 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702da864-3fd9-4a42-88ce-543cea61379e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:46.094962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:46.148207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-702da864-3fd9-4a42-88ce-543cea61379e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899c87e21e2a459197486b69c0c3db6b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:46.157516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-702da864-3fd9-4a42-88ce-543cea61379e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899c87e21e2a459197486b69c0c3db6b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:46.158296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-702da864-3fd9-4a42-88ce-543cea61379e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899c87e21e2a459197486b69c0c3db6b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:46.159007 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-702da864-3fd9-4a42-88ce-543cea61379e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899c87e21e2a459197486b69c0c3db6b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:46.173652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-702da864-3fd9-4a42-88ce-543cea61379e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899c87e21e2a459197486b69c0c3db6b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:46.190686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1092/2165] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:46 2022] DELETE /identity/v3/users/899c87e21e2a459197486b69c0c3db6b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:46.476010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:46.481681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:46.520095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7e451-bb4f-4635-be48-78501f17ba23 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:46.584409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:46.585546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:46.585835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:46.586279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] PATH_INFO: `/v3/projects/4616aceae32140bd9cf47c1b6c6a148a` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:46.587495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=4616aceae32140bd9cf47c1b6c6a148a)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:46.590020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:46.638655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4616aceae32140bd9cf47c1b6c6a148a', 'request_id': 'req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:46.644565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4616aceae32140bd9cf47c1b6c6a148a', 'request_id': 'req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:46.654128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4616aceae32140bd9cf47c1b6c6a148a', 'request_id': 'req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:46.665371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] The token cache is being invalidate because project 4616aceae32140bd9cf47c1b6c6a148a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:46.665674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:46.666869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3dbb29e1-de56-400d-84bb-9f0fbdc2a9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:46.668444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1074/2166] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:46 2022] DELETE /identity/v3/projects/4616aceae32140bd9cf47c1b6c6a148a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:46.673230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd579802-cbe9-485e-95f3-13c9250ef356 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:46.673921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd579802-cbe9-485e-95f3-13c9250ef356 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:46.674437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd579802-cbe9-485e-95f3-13c9250ef356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:46.692389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-cd579802-cbe9-485e-95f3-13c9250ef356 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:46.693670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-cd579802-cbe9-485e-95f3-13c9250ef356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:46.754837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1093/2167] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:46.762420 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e47f81-62b8-410a-91e6-b10ab4121c21 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:46.762712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e47f81-62b8-410a-91e6-b10ab4121c21 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:46.762989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e47f81-62b8-410a-91e6-b10ab4121c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:46.781796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-71e47f81-62b8-410a-91e6-b10ab4121c21 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:46.783000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-71e47f81-62b8-410a-91e6-b10ab4121c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:46.791070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1075/2168] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:46.795443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd579802-cbe9-485e-95f3-13c9250ef356 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:46.805015 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd579802-cbe9-485e-95f3-13c9250ef356 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:46.809512 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce118ad-3dba-47b5-82ab-be40e9e7d6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:46.810541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce118ad-3dba-47b5-82ab-be40e9e7d6cb admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:46.810827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce118ad-3dba-47b5-82ab-be40e9e7d6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:46.811101 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce118ad-3dba-47b5-82ab-be40e9e7d6cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:46.811943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce118ad-3dba-47b5-82ab-be40e9e7d6cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:46.812254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce118ad-3dba-47b5-82ab-be40e9e7d6cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:46.813867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce118ad-3dba-47b5-82ab-be40e9e7d6cb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:46.824985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1094/2169] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:46.829127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e47f81-62b8-410a-91e6-b10ab4121c21 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:46.839050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e47f81-62b8-410a-91e6-b10ab4121c21 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:46.843639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9521f17-0238-4c16-b60f-be672a13094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:46.844271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9521f17-0238-4c16-b60f-be672a13094d admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:46.844584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9521f17-0238-4c16-b60f-be672a13094d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:46.844855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9521f17-0238-4c16-b60f-be672a13094d admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:46.845530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9521f17-0238-4c16-b60f-be672a13094d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:46.847414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9521f17-0238-4c16-b60f-be672a13094d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:46.872604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1076/2170] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:46 2022] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:46.877258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce118ad-3dba-47b5-82ab-be40e9e7d6cb admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:46.887333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce118ad-3dba-47b5-82ab-be40e9e7d6cb admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:46.943439 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af68cd9-33f2-4c0e-92d4-6963bc0dcc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:46.944440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af68cd9-33f2-4c0e-92d4-6963bc0dcc8a admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:46.944912 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af68cd9-33f2-4c0e-92d4-6963bc0dcc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:46.945377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af68cd9-33f2-4c0e-92d4-6963bc0dcc8a admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:46.946209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af68cd9-33f2-4c0e-92d4-6963bc0dcc8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:46.948809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af68cd9-33f2-4c0e-92d4-6963bc0dcc8a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:46.966367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:46.978392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9521f17-0238-4c16-b60f-be672a13094d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:46.978844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1095/2171] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:46 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:46.993749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9521f17-0238-4c16-b60f-be672a13094d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:46.999822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61655cd5-90ee-4d4f-9477-ccc26067d103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:47.000742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61655cd5-90ee-4d4f-9477-ccc26067d103 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:47.001241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61655cd5-90ee-4d4f-9477-ccc26067d103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:47.001619 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61655cd5-90ee-4d4f-9477-ccc26067d103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:47.002510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61655cd5-90ee-4d4f-9477-ccc26067d103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:47.004218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61655cd5-90ee-4d4f-9477-ccc26067d103 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:47.010675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:47.021117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1077/2172] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:47.023528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af68cd9-33f2-4c0e-92d4-6963bc0dcc8a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:47.034754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af68cd9-33f2-4c0e-92d4-6963bc0dcc8a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:47.041131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8317d-4442-4c77-8606-5433c69ddeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:47.041759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8317d-4442-4c77-8606-5433c69ddeac admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:47.042109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8317d-4442-4c77-8606-5433c69ddeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:47.042314 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8317d-4442-4c77-8606-5433c69ddeac admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:47.043304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8317d-4442-4c77-8606-5433c69ddeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:47.044962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8317d-4442-4c77-8606-5433c69ddeac admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:47.055800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1096/2173] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:47.059822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61655cd5-90ee-4d4f-9477-ccc26067d103 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:47.069934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61655cd5-90ee-4d4f-9477-ccc26067d103 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:47.075133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c82ee0-7438-4b9e-8693-9087026dbe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:47.076009 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c82ee0-7438-4b9e-8693-9087026dbe9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:47.076291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c82ee0-7438-4b9e-8693-9087026dbe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:47.076598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c82ee0-7438-4b9e-8693-9087026dbe9e admin admin] PATH_INFO: `/v3/projects/e64c1706fefb4fc78b9555319b62f260/users/07dfb0fdfa1a41ab8590ba4c57a7896c/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:47.091730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c82ee0-7438-4b9e-8693-9087026dbe9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64c1706fefb4fc78b9555319b62f260, user_id=07dfb0fdfa1a41ab8590ba4c57a7896c, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:47.094448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c82ee0-7438-4b9e-8693-9087026dbe9e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:47.107961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1078/2174] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:47 2022] PUT /identity/v3/projects/e64c1706fefb4fc78b9555319b62f260/users/07dfb0fdfa1a41ab8590ba4c57a7896c/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:47.119335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956c77d-d8b4-4f41-807b-0923fa8d6b3d None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:47.119629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956c77d-d8b4-4f41-807b-0923fa8d6b3d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:47.119912 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956c77d-d8b4-4f41-807b-0923fa8d6b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:47.146368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-7956c77d-d8b4-4f41-807b-0923fa8d6b3d None None] MFA Rules not processed for user `07dfb0fdfa1a41ab8590ba4c57a7896c`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:47.147554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7956c77d-d8b4-4f41-807b-0923fa8d6b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:47.211809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1097/2175] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:47.224637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c82ee0-7438-4b9e-8693-9087026dbe9e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:47.226544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-67c82ee0-7438-4b9e-8693-9087026dbe9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:47.292115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c82ee0-7438-4b9e-8693-9087026dbe9e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:47.295940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bfef5-8782-4d3d-9709-17740f909414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:47.297074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bfef5-8782-4d3d-9709-17740f909414 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:47.297074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bfef5-8782-4d3d-9709-17740f909414 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:47.297269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bfef5-8782-4d3d-9709-17740f909414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:47.308132 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bfef5-8782-4d3d-9709-17740f909414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:47.310374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bfef5-8782-4d3d-9709-17740f909414 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:47.320970 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1079/2176] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:51.930019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956c77d-d8b4-4f41-807b-0923fa8d6b3d None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:51.931481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7956c77d-d8b4-4f41-807b-0923fa8d6b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:51.995401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956c77d-d8b4-4f41-807b-0923fa8d6b3d None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:51.999902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:52.000792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:52.001080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:52.001361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] PATH_INFO: `/v3/users/9f6d412273874a6f9b170ecc4af5055b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:52.002548 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f6d412273874a6f9b170ecc4af5055b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:52.004516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:52.051097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f6d412273874a6f9b170ecc4af5055b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.058379 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f6d412273874a6f9b170ecc4af5055b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.059042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f6d412273874a6f9b170ecc4af5055b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.059652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f6d412273874a6f9b170ecc4af5055b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.071642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f6d412273874a6f9b170ecc4af5055b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.080001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:52.085468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1098/2177] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:51 2022] DELETE /identity/v3/users/9f6d412273874a6f9b170ecc4af5055b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:52.091020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d512851-1a48-4621-a126-d3db8cc1535d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:52.091688 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d512851-1a48-4621-a126-d3db8cc1535d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:52.091688 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d512851-1a48-4621-a126-d3db8cc1535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:52.109041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7d512851-1a48-4621-a126-d3db8cc1535d None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:52.110247 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7d512851-1a48-4621-a126-d3db8cc1535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:52.173188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1080/2178] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:08:52.182805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:52.184216 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:52.240701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5184c6a-e734-46d2-a45d-09e932316d70 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:52.244815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ac984-2e00-4317-942c-6690bdd1c577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:52.245454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ac984-2e00-4317-942c-6690bdd1c577 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:52.245735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ac984-2e00-4317-942c-6690bdd1c577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:52.246005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ac984-2e00-4317-942c-6690bdd1c577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:52.255054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ac984-2e00-4317-942c-6690bdd1c577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:52.256509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ac984-2e00-4317-942c-6690bdd1c577 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:52.266351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1099/2179] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:52.440776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d512851-1a48-4621-a126-d3db8cc1535d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:52.442168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7d512851-1a48-4621-a126-d3db8cc1535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:52.454741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d512851-1a48-4621-a126-d3db8cc1535d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:52.459363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6570b9-d695-4c69-9762-851fb6a456b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:52.460220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6570b9-d695-4c69-9762-851fb6a456b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:52.460532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6570b9-d695-4c69-9762-851fb6a456b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:52.460807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6570b9-d695-4c69-9762-851fb6a456b8 admin admin] PATH_INFO: `/v3/users/07dfb0fdfa1a41ab8590ba4c57a7896c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:52.462061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6570b9-d695-4c69-9762-851fb6a456b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07dfb0fdfa1a41ab8590ba4c57a7896c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:52.464608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6570b9-d695-4c69-9762-851fb6a456b8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:52.512616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fd6570b9-d695-4c69-9762-851fb6a456b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07dfb0fdfa1a41ab8590ba4c57a7896c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.513297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fd6570b9-d695-4c69-9762-851fb6a456b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07dfb0fdfa1a41ab8590ba4c57a7896c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.520605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fd6570b9-d695-4c69-9762-851fb6a456b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07dfb0fdfa1a41ab8590ba4c57a7896c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.528286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fd6570b9-d695-4c69-9762-851fb6a456b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07dfb0fdfa1a41ab8590ba4c57a7896c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.528940 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fd6570b9-d695-4c69-9762-851fb6a456b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07dfb0fdfa1a41ab8590ba4c57a7896c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.539846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ac984-2e00-4317-942c-6690bdd1c577 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:52.541564 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-565ac984-2e00-4317-942c-6690bdd1c577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:52.542084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:52.555873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1081/2180] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:52 2022] DELETE /identity/v3/users/07dfb0fdfa1a41ab8590ba4c57a7896c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:52.560347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29136-d367-4587-a748-a130b42e1b21 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:52.560727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29136-d367-4587-a748-a130b42e1b21 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:52.561999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e29136-d367-4587-a748-a130b42e1b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:52.567314 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ac984-2e00-4317-942c-6690bdd1c577 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:52.582469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d2e29136-d367-4587-a748-a130b42e1b21 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:52.584291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d2e29136-d367-4587-a748-a130b42e1b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:52.640283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:52.641396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:52.641760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:52.642170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] PATH_INFO: `/v3/projects/530104917040497fb8ab0f1c2ac58a42` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:52.643868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=530104917040497fb8ab0f1c2ac58a42)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:52.646614 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:52.656344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1082/2181] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:52.657654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5a6d5-bd6e-459b-a6bf-c6983287f3ca None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:52.657941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5a6d5-bd6e-459b-a6bf-c6983287f3ca None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:52.658217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5a6d5-bd6e-459b-a6bf-c6983287f3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:52.678489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e8f5a6d5-bd6e-459b-a6bf-c6983287f3ca None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:52.680214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e8f5a6d5-bd6e-459b-a6bf-c6983287f3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:52.700684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530104917040497fb8ab0f1c2ac58a42', 'request_id': 'req-9208fc29-c2c5-4713-a6fa-c16fee09b645'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.706418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530104917040497fb8ab0f1c2ac58a42', 'request_id': 'req-9208fc29-c2c5-4713-a6fa-c16fee09b645'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.712585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530104917040497fb8ab0f1c2ac58a42', 'request_id': 'req-9208fc29-c2c5-4713-a6fa-c16fee09b645'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.725453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] The token cache is being invalidate because project 530104917040497fb8ab0f1c2ac58a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:52.725747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.726537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.728118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1100/2182] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:52 2022] DELETE /identity/v3/projects/530104917040497fb8ab0f1c2ac58a42 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:52.729020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:52.730351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:52.743423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1083/2183] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:08:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:52.744933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5a6d5-bd6e-459b-a6bf-c6983287f3ca None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:52.746164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e8f5a6d5-bd6e-459b-a6bf-c6983287f3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:52.765049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5a6d5-bd6e-459b-a6bf-c6983287f3ca None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:52.767386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:52.797818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208fc29-c2c5-4713-a6fa-c16fee09b645 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:52.801476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3b990-de8f-48e3-bfca-91712f331339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:52.802151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3b990-de8f-48e3-bfca-91712f331339 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:52.802439 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3b990-de8f-48e3-bfca-91712f331339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:52.802718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3b990-de8f-48e3-bfca-91712f331339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:52.804567 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-02a3b990-de8f-48e3-bfca-91712f331339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:52.833182 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:52.834134 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:52.834489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:52.834832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] PATH_INFO: `/v3/users/e2a21cc1ac6241348436808c7bf4d2e3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:52.836285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a21cc1ac6241348436808c7bf4d2e3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:52.838571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:52.890248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:52.901069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3b990-de8f-48e3-bfca-91712f331339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:52.902483 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3b990-de8f-48e3-bfca-91712f331339 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:52.904807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a21cc1ac6241348436808c7bf4d2e3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.905530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a21cc1ac6241348436808c7bf4d2e3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.913217 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1101/2184] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:52.914057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3b990-de8f-48e3-bfca-91712f331339 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:52.915370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-02a3b990-de8f-48e3-bfca-91712f331339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:52.917955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a21cc1ac6241348436808c7bf4d2e3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.928847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a21cc1ac6241348436808c7bf4d2e3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.932492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a21cc1ac6241348436808c7bf4d2e3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:52.971477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1084/2185] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:08:52 2022] DELETE /identity/v3/users/e2a21cc1ac6241348436808c7bf4d2e3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:53.012788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3b990-de8f-48e3-bfca-91712f331339 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:53.091104 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed9efd-d0f8-4275-9ac4-219e41df66a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:53.091932 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed9efd-d0f8-4275-9ac4-219e41df66a5 service swift] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:53.092245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed9efd-d0f8-4275-9ac4-219e41df66a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:53.092602 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed9efd-d0f8-4275-9ac4-219e41df66a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:53.094921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-87ed9efd-d0f8-4275-9ac4-219e41df66a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:53.125767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:53.179361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed9efd-d0f8-4275-9ac4-219e41df66a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:53.182012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed9efd-d0f8-4275-9ac4-219e41df66a5 service swift] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:53.192075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1102/2186] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:08:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:08:53.378285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:53.379912 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:53.416493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed9efd-d0f8-4275-9ac4-219e41df66a5 service swift] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:53.418784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-87ed9efd-d0f8-4275-9ac4-219e41df66a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:53.540846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bec0e1-b6ca-4faa-a03b-06f60428fb84 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:53.551116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:53.552399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:53.552848 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:53.553215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] PATH_INFO: `/v3/projects/e64c1706fefb4fc78b9555319b62f260` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:53.554883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64c1706fefb4fc78b9555319b62f260)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:53.558469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:53.584689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed9efd-d0f8-4275-9ac4-219e41df66a5 service swift] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:53.592948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:53.593792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:53.594079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:53.594358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] PATH_INFO: `/v3/projects/091923b24b40400ea225c1f184c3551f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:53.595595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=091923b24b40400ea225c1f184c3551f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:53.597954 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:53.622913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64c1706fefb4fc78b9555319b62f260', 'request_id': 'req-f786b290-e593-4e49-a245-69d8c45d27aa'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:53.631919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64c1706fefb4fc78b9555319b62f260', 'request_id': 'req-f786b290-e593-4e49-a245-69d8c45d27aa'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:53.658136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64c1706fefb4fc78b9555319b62f260', 'request_id': 'req-f786b290-e593-4e49-a245-69d8c45d27aa'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:53.678315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] The token cache is being invalidate because project e64c1706fefb4fc78b9555319b62f260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:53.678852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:53.679529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f786b290-e593-4e49-a245-69d8c45d27aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:53.682445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1085/2187] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:53 2022] DELETE /identity/v3/projects/e64c1706fefb4fc78b9555319b62f260 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:53.685604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091923b24b40400ea225c1f184c3551f', 'request_id': 'req-75936516-0bd0-40b9-a234-c30d74fe2d05'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:53.688888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2e87-d212-43ae-b00f-cbe54bfed80f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:53.689130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2e87-d212-43ae-b00f-cbe54bfed80f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:53.689412 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad2e87-d212-43ae-b00f-cbe54bfed80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:53.694979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091923b24b40400ea225c1f184c3551f', 'request_id': 'req-75936516-0bd0-40b9-a234-c30d74fe2d05'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:53.713089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091923b24b40400ea225c1f184c3551f', 'request_id': 'req-75936516-0bd0-40b9-a234-c30d74fe2d05'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:53.727593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-84ad2e87-d212-43ae-b00f-cbe54bfed80f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:53.731769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-84ad2e87-d212-43ae-b00f-cbe54bfed80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:53.736077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] The token cache is being invalidate because project 091923b24b40400ea225c1f184c3551f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:08:53.736750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:53.737804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-75936516-0bd0-40b9-a234-c30d74fe2d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:08:53.739947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1103/2188] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:08:53 2022] DELETE /identity/v3/projects/091923b24b40400ea225c1f184c3551f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:53.745435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2e519-8bb5-4702-9634-11d5b9c7ba43 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:53.746860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2e519-8bb5-4702-9634-11d5b9c7ba43 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:53.747352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2e519-8bb5-4702-9634-11d5b9c7ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:53.779341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-6aa2e519-8bb5-4702-9634-11d5b9c7ba43 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:53.780715 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6aa2e519-8bb5-4702-9634-11d5b9c7ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:53.822417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:53.865594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:53.868191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1086/2189] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:53.870683 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b4e82-895d-4c74-98ca-12f6cae13307 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:53.870975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b4e82-895d-4c74-98ca-12f6cae13307 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:53.871242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b4e82-895d-4c74-98ca-12f6cae13307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:53.893870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1104/2190] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:53.896187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96191d-fc3a-44d5-ac91-512cfcf5822d None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:53.896918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96191d-fc3a-44d5-ac91-512cfcf5822d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:53.897569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96191d-fc3a-44d5-ac91-512cfcf5822d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:53.911558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-be0b4e82-895d-4c74-98ca-12f6cae13307 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:53.913640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-be0b4e82-895d-4c74-98ca-12f6cae13307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:53.920997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-de96191d-fc3a-44d5-ac91-512cfcf5822d None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:53.922308 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-de96191d-fc3a-44d5-ac91-512cfcf5822d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:53.928449 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1087/2191] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:53.930198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b4e82-895d-4c74-98ca-12f6cae13307 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:53.934683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1105/2192] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:53.939255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96191d-fc3a-44d5-ac91-512cfcf5822d None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:53.942301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b4e82-895d-4c74-98ca-12f6cae13307 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:53.947648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e978-83e5-4c85-8ba9-731bc3f8ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:53.948539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e978-83e5-4c85-8ba9-731bc3f8ca47 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:53.949062 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e978-83e5-4c85-8ba9-731bc3f8ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:53.949515 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6e978-83e5-4c85-8ba9-731bc3f8ca47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:53.950012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96191d-fc3a-44d5-ac91-512cfcf5822d None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:53.951060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6e978-83e5-4c85-8ba9-731bc3f8ca47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:53.951517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6e978-83e5-4c85-8ba9-731bc3f8ca47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:53.955166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6e978-83e5-4c85-8ba9-731bc3f8ca47 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:53.955965 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad727b-8888-4981-bc1c-8e47d1c31150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:53.956758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad727b-8888-4981-bc1c-8e47d1c31150 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:53.957114 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad727b-8888-4981-bc1c-8e47d1c31150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:53.957456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad727b-8888-4981-bc1c-8e47d1c31150 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:53.958326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad727b-8888-4981-bc1c-8e47d1c31150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:08:53.958947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad727b-8888-4981-bc1c-8e47d1c31150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:53.961180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad727b-8888-4981-bc1c-8e47d1c31150 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:53.975090 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1088/2193] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:08:53.976094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e978-83e5-4c85-8ba9-731bc3f8ca47 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:53.979218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1106/2194] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:08:53.980082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad727b-8888-4981-bc1c-8e47d1c31150 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:53.987714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6e978-83e5-4c85-8ba9-731bc3f8ca47 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:53.992220 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad727b-8888-4981-bc1c-8e47d1c31150 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:53.993504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a33b56-63ef-4753-8575-88441a4ecf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:53.995481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a33b56-63ef-4753-8575-88441a4ecf49 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:53.996231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a33b56-63ef-4753-8575-88441a4ecf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:53.996656 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a33b56-63ef-4753-8575-88441a4ecf49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:53.997889 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a33b56-63ef-4753-8575-88441a4ecf49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:53.998223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba603a-eca7-427f-8a61-f7333e68a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:53.999091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba603a-eca7-427f-8a61-f7333e68a866 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:53.999580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba603a-eca7-427f-8a61-f7333e68a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:53.999929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba603a-eca7-427f-8a61-f7333e68a866 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.001134 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba603a-eca7-427f-8a61-f7333e68a866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.001392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a33b56-63ef-4753-8575-88441a4ecf49 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.003326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba603a-eca7-427f-8a61-f7333e68a866 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.037759 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1089/2195] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:53 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:54.038511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1107/2196] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:53 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:54.044078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba603a-eca7-427f-8a61-f7333e68a866 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.044501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a33b56-63ef-4753-8575-88441a4ecf49 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.126579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a33b56-63ef-4753-8575-88441a4ecf49 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.133393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772ec60-96f5-482c-b43b-387e27520ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.133610 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ec60-96f5-482c-b43b-387e27520ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.133862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ec60-96f5-482c-b43b-387e27520ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.134137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ec60-96f5-482c-b43b-387e27520ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.134865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772ec60-96f5-482c-b43b-387e27520ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.134985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba603a-eca7-427f-8a61-f7333e68a866 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.138010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772ec60-96f5-482c-b43b-387e27520ed8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.151455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c532be-70ce-4c78-94b3-664eedc3ea0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.152133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c532be-70ce-4c78-94b3-664eedc3ea0b admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.152567 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c532be-70ce-4c78-94b3-664eedc3ea0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.152903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c532be-70ce-4c78-94b3-664eedc3ea0b admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.153833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c532be-70ce-4c78-94b3-664eedc3ea0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.157882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c532be-70ce-4c78-94b3-664eedc3ea0b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.169404 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1090/2197] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:54 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:54.170953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772ec60-96f5-482c-b43b-387e27520ed8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.187355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772ec60-96f5-482c-b43b-387e27520ed8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.199234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1a060-c562-4d77-9170-075deaa243fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.200026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1a060-c562-4d77-9170-075deaa243fb admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.200860 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1a060-c562-4d77-9170-075deaa243fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.201358 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1a060-c562-4d77-9170-075deaa243fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.203423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1a060-c562-4d77-9170-075deaa243fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.205251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1a060-c562-4d77-9170-075deaa243fb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.206043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1108/2198] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:54 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:54.214669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c532be-70ce-4c78-94b3-664eedc3ea0b admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.225693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1091/2199] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:54.227213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1a060-c562-4d77-9170-075deaa243fb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.230642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c532be-70ce-4c78-94b3-664eedc3ea0b admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.236833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e782ec-12d9-4959-b671-13d484407cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.238105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e782ec-12d9-4959-b671-13d484407cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.238595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e782ec-12d9-4959-b671-13d484407cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.239130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e782ec-12d9-4959-b671-13d484407cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.240070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e782ec-12d9-4959-b671-13d484407cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.240559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1a060-c562-4d77-9170-075deaa243fb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.242700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e782ec-12d9-4959-b671-13d484407cf7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.246793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9bcae-5a88-4276-b970-719a7c90813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.247479 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9bcae-5a88-4276-b970-719a7c90813f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.251119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9bcae-5a88-4276-b970-719a7c90813f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.251467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9bcae-5a88-4276-b970-719a7c90813f admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.252339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9bcae-5a88-4276-b970-719a7c90813f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.254571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9bcae-5a88-4276-b970-719a7c90813f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.257070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1109/2200] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:54.262244 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e782ec-12d9-4959-b671-13d484407cf7 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.279802 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1092/2201] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:54.280880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9bcae-5a88-4276-b970-719a7c90813f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.285434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e782ec-12d9-4959-b671-13d484407cf7 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.295069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9bcae-5a88-4276-b970-719a7c90813f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.295886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b9a80-3609-4c6b-a2dd-331973fde3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.297594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b9a80-3609-4c6b-a2dd-331973fde3ef admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.298864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b9a80-3609-4c6b-a2dd-331973fde3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.299448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b9a80-3609-4c6b-a2dd-331973fde3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.300927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b9a80-3609-4c6b-a2dd-331973fde3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.301923 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2d316-6f77-4460-9ded-b6af9e53c83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.303262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2d316-6f77-4460-9ded-b6af9e53c83a admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.303693 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2d316-6f77-4460-9ded-b6af9e53c83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.304156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2d316-6f77-4460-9ded-b6af9e53c83a admin admin] PATH_INFO: `/v3/projects/146149e6b11e447cbefaba99dc6c4f15/users/0883c5f7ca2f4f49b99e85350b5ca526/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.304672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b9a80-3609-4c6b-a2dd-331973fde3ef admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.333128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1110/2202] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:54.334535 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2d316-6f77-4460-9ded-b6af9e53c83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=146149e6b11e447cbefaba99dc6c4f15, user_id=0883c5f7ca2f4f49b99e85350b5ca526, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.338938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b9a80-3609-4c6b-a2dd-331973fde3ef admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.340085 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2d316-6f77-4460-9ded-b6af9e53c83a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.354354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b9a80-3609-4c6b-a2dd-331973fde3ef admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.363308 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e7ac6-c517-4207-bec1-38600e8a0ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.364035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7ac6-c517-4207-bec1-38600e8a0ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.364334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7ac6-c517-4207-bec1-38600e8a0ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.364606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e7ac6-c517-4207-bec1-38600e8a0ac9 admin admin] PATH_INFO: `/v3/projects/cf04dca30c5445bd84164651af96d49c/users/42a60fd5d5fb45b594fb23dbca0917a3/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.380597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1093/2203] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:54 2022] PUT /identity/v3/projects/146149e6b11e447cbefaba99dc6c4f15/users/0883c5f7ca2f4f49b99e85350b5ca526/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:54.414787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e7ac6-c517-4207-bec1-38600e8a0ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf04dca30c5445bd84164651af96d49c, user_id=42a60fd5d5fb45b594fb23dbca0917a3, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.415098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c4e17-88a2-4853-b911-c75c3656b6f1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.415098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c4e17-88a2-4853-b911-c75c3656b6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.415098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c4e17-88a2-4853-b911-c75c3656b6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.421422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e7ac6-c517-4207-bec1-38600e8a0ac9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.448354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-620c4e17-88a2-4853-b911-c75c3656b6f1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:54.451739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-620c4e17-88a2-4853-b911-c75c3656b6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:54.458950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1111/2204] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:54 2022] PUT /identity/v3/projects/cf04dca30c5445bd84164651af96d49c/users/42a60fd5d5fb45b594fb23dbca0917a3/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:54.470651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eece8e-9110-4336-b62a-41a7e6209927 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.471178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eece8e-9110-4336-b62a-41a7e6209927 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.471178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eece8e-9110-4336-b62a-41a7e6209927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.511856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-35eece8e-9110-4336-b62a-41a7e6209927 None None] MFA Rules not processed for user `42a60fd5d5fb45b594fb23dbca0917a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:54.513261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-35eece8e-9110-4336-b62a-41a7e6209927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:54.521120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:54.558684 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1094/2205] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:08:54.579197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c4e17-88a2-4853-b911-c75c3656b6f1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.583471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-620c4e17-88a2-4853-b911-c75c3656b6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:54.613686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:54.653413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1112/2206] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:08:54.654588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eece8e-9110-4336-b62a-41a7e6209927 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.667830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eece8e-9110-4336-b62a-41a7e6209927 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.672642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b48a2-9470-47fa-a037-8f715b89e816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.673320 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b48a2-9470-47fa-a037-8f715b89e816 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.673629 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b48a2-9470-47fa-a037-8f715b89e816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.674018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b48a2-9470-47fa-a037-8f715b89e816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.674800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b48a2-9470-47fa-a037-8f715b89e816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.677193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b48a2-9470-47fa-a037-8f715b89e816 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.713830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1113/2207] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:08:54 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:54.731014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b48a2-9470-47fa-a037-8f715b89e816 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.731254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c4e17-88a2-4853-b911-c75c3656b6f1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.811711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b48a2-9470-47fa-a037-8f715b89e816 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.818619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5510-50ad-4547-b84d-b0742ae33bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.819447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5510-50ad-4547-b84d-b0742ae33bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.820148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5510-50ad-4547-b84d-b0742ae33bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.820148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d5510-50ad-4547-b84d-b0742ae33bcd admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.821180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d5510-50ad-4547-b84d-b0742ae33bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.823418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d5510-50ad-4547-b84d-b0742ae33bcd admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.848907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d270-d64a-4de4-9a6c-d13a1a5a61ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.848907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d270-d64a-4de4-9a6c-d13a1a5a61ab service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.849267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d270-d64a-4de4-9a6c-d13a1a5a61ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.849394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d270-d64a-4de4-9a6c-d13a1a5a61ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.863570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1114/2208] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:08:54 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:08:54.865429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5510-50ad-4547-b84d-b0742ae33bcd admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.877905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d270-d64a-4de4-9a6c-d13a1a5a61ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.879370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d270-d64a-4de4-9a6c-d13a1a5a61ab service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.879501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d5510-50ad-4547-b84d-b0742ae33bcd admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.885764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccddb11-553d-4b78-82fa-38ce785f7b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.887154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccddb11-553d-4b78-82fa-38ce785f7b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.888412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccddb11-553d-4b78-82fa-38ce785f7b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.888412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccddb11-553d-4b78-82fa-38ce785f7b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.889272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccddb11-553d-4b78-82fa-38ce785f7b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.891520 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccddb11-553d-4b78-82fa-38ce785f7b76 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.904978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1095/2209] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:08:54.915053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1115/2210] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:54.916535 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d270-d64a-4de4-9a6c-d13a1a5a61ab service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:54.929643 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d270-d64a-4de4-9a6c-d13a1a5a61ab service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:54.935313 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f6cf8-4326-4690-869b-70112643cae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:54.936220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f6cf8-4326-4690-869b-70112643cae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:54.936552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f6cf8-4326-4690-869b-70112643cae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:54.936822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f6cf8-4326-4690-869b-70112643cae2 admin admin] PATH_INFO: `/v3/projects/1ad529157ab24ce5ba95a2780d90c697/users/961a30020bc9431a9060b15403a1f0ce/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:54.955681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f6cf8-4326-4690-869b-70112643cae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad529157ab24ce5ba95a2780d90c697, user_id=961a30020bc9431a9060b15403a1f0ce, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:54.971685 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f6cf8-4326-4690-869b-70112643cae2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:54.989844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1096/2211] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:54 2022] PUT /identity/v3/projects/1ad529157ab24ce5ba95a2780d90c697/users/961a30020bc9431a9060b15403a1f0ce/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:08:54.994205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccddb11-553d-4b78-82fa-38ce785f7b76 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:55.017481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccddb11-553d-4b78-82fa-38ce785f7b76 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:55.156946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595c31d-fbd1-4b02-b988-fd5215a0ee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:55.157832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c31d-fbd1-4b02-b988-fd5215a0ee07 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:55.157941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c31d-fbd1-4b02-b988-fd5215a0ee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:55.158567 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595c31d-fbd1-4b02-b988-fd5215a0ee07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:55.160733 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595c31d-fbd1-4b02-b988-fd5215a0ee07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:55.162587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595c31d-fbd1-4b02-b988-fd5215a0ee07 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:55.203582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1116/2212] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:08:55.206077 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f6cf8-4326-4690-869b-70112643cae2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:55.235902 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f6cf8-4326-4690-869b-70112643cae2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:55.247180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c6766-e027-421e-839e-5eed6bf8e624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:55.251147 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c6766-e027-421e-839e-5eed6bf8e624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:55.252732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c6766-e027-421e-839e-5eed6bf8e624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:55.253557 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c6766-e027-421e-839e-5eed6bf8e624 admin admin] PATH_INFO: `/v3/projects/1ad529157ab24ce5ba95a2780d90c697/users/961a30020bc9431a9060b15403a1f0ce/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:55.258498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c6766-e027-421e-839e-5eed6bf8e624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad529157ab24ce5ba95a2780d90c697, user_id=961a30020bc9431a9060b15403a1f0ce, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:55.266251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c6766-e027-421e-839e-5eed6bf8e624 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:55.281435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1097/2213] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:08:55 2022] PUT /identity/v3/projects/1ad529157ab24ce5ba95a2780d90c697/users/961a30020bc9431a9060b15403a1f0ce/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:08:55.292746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbbd60-29ed-4d74-b07c-cdefeb74d367 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:55.293128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbbd60-29ed-4d74-b07c-cdefeb74d367 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:55.293541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbbd60-29ed-4d74-b07c-cdefeb74d367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:55.332954 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-42dbbd60-29ed-4d74-b07c-cdefeb74d367 None None] MFA Rules not processed for user `961a30020bc9431a9060b15403a1f0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:08:55.335331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-42dbbd60-29ed-4d74-b07c-cdefeb74d367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:55.380115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:55.492249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1117/2214] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:08:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:08:55.504288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c6766-e027-421e-839e-5eed6bf8e624 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:55.506036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-353c6766-e027-421e-839e-5eed6bf8e624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:08:55.663605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c6766-e027-421e-839e-5eed6bf8e624 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:55.680066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca8318-a1e7-40f1-8aef-5076f13b100f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:55.680844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca8318-a1e7-40f1-8aef-5076f13b100f service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:55.681738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca8318-a1e7-40f1-8aef-5076f13b100f service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:55.682022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca8318-a1e7-40f1-8aef-5076f13b100f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:55.741078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:08:55.810212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca8318-a1e7-40f1-8aef-5076f13b100f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:55.812284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca8318-a1e7-40f1-8aef-5076f13b100f service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:55.828557 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1098/2215] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:08:57.422177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbbd60-29ed-4d74-b07c-cdefeb74d367 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:08:57.435803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbbd60-29ed-4d74-b07c-cdefeb74d367 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:08:57.443997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b04e1-61c9-4e4e-a449-fed2578e5aa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:08:57.444793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b04e1-61c9-4e4e-a449-fed2578e5aa8 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:08:57.445082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b04e1-61c9-4e4e-a449-fed2578e5aa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:08:57.445357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b04e1-61c9-4e4e-a449-fed2578e5aa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:08:57.461929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b04e1-61c9-4e4e-a449-fed2578e5aa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:08:57.463803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b04e1-61c9-4e4e-a449-fed2578e5aa8 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:08:57.492420 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1118/2216] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:08:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:01.277644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9a2e3-b343-4ab9-a779-0f356d40baa2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:01.278352 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9a2e3-b343-4ab9-a779-0f356d40baa2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:01.279302 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9a2e3-b343-4ab9-a779-0f356d40baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:01.339893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-21d9a2e3-b343-4ab9-a779-0f356d40baa2 None None] MFA Rules not processed for user `0883c5f7ca2f4f49b99e85350b5ca526`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:01.341187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-21d9a2e3-b343-4ab9-a779-0f356d40baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:01.441349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1099/2217] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:01.442434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b04e1-61c9-4e4e-a449-fed2578e5aa8 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:01.584941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b04e1-61c9-4e4e-a449-fed2578e5aa8 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:01.596143 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5e5b2-99d0-4e67-b1f6-b30b3d0e85ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:01.596871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5e5b2-99d0-4e67-b1f6-b30b3d0e85ca admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:01.597159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5e5b2-99d0-4e67-b1f6-b30b3d0e85ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:01.597439 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5e5b2-99d0-4e67-b1f6-b30b3d0e85ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:01.598145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5e5b2-99d0-4e67-b1f6-b30b3d0e85ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:01.600170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d5e5b2-99d0-4e67-b1f6-b30b3d0e85ca admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:01.628835 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1119/2218] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:01 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:01.632948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9a2e3-b343-4ab9-a779-0f356d40baa2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:01.649121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9a2e3-b343-4ab9-a779-0f356d40baa2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:01.749121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a16290-37da-496f-b200-c35f03252bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:01.749753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a16290-37da-496f-b200-c35f03252bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:01.750042 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a16290-37da-496f-b200-c35f03252bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:01.750322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a16290-37da-496f-b200-c35f03252bfb admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:01.751174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a16290-37da-496f-b200-c35f03252bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:01.753256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a16290-37da-496f-b200-c35f03252bfb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:01.782928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1100/2219] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:01 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:01.786609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5e5b2-99d0-4e67-b1f6-b30b3d0e85ca admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:01.802920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5e5b2-99d0-4e67-b1f6-b30b3d0e85ca admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:01.814709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db08ef-a676-451f-bf5c-43588928808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:01.814709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db08ef-a676-451f-bf5c-43588928808e admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:01.814709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db08ef-a676-451f-bf5c-43588928808e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:01.814986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db08ef-a676-451f-bf5c-43588928808e admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:01.816097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db08ef-a676-451f-bf5c-43588928808e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:01.821976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db08ef-a676-451f-bf5c-43588928808e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:01.839665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a16290-37da-496f-b200-c35f03252bfb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:01.845005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1120/2220] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:01.851406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a16290-37da-496f-b200-c35f03252bfb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:01.857232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6014e8-b086-4740-8511-58ef1e2315f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:01.858267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6014e8-b086-4740-8511-58ef1e2315f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:01.858676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6014e8-b086-4740-8511-58ef1e2315f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:01.859022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6014e8-b086-4740-8511-58ef1e2315f5 admin admin] PATH_INFO: `/v3/projects/07c640b00c4341259670bbe22bcdf0c8/users/af12629dee2d4dda92d4b317468f155b/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:01.882541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6014e8-b086-4740-8511-58ef1e2315f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c640b00c4341259670bbe22bcdf0c8, user_id=af12629dee2d4dda92d4b317468f155b, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:01.885516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6014e8-b086-4740-8511-58ef1e2315f5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:01.917704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db08ef-a676-451f-bf5c-43588928808e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:01.927552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1101/2221] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:01 2022] PUT /identity/v3/projects/07c640b00c4341259670bbe22bcdf0c8/users/af12629dee2d4dda92d4b317468f155b/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:01.936455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db08ef-a676-451f-bf5c-43588928808e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:02.000251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6014e8-b086-4740-8511-58ef1e2315f5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:02.047181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:02.079734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60056b-f4e3-42df-92bf-6be759ecec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:02.080797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60056b-f4e3-42df-92bf-6be759ecec96 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:02.081242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60056b-f4e3-42df-92bf-6be759ecec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:02.081674 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60056b-f4e3-42df-92bf-6be759ecec96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:02.082557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60056b-f4e3-42df-92bf-6be759ecec96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:02.090608 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60056b-f4e3-42df-92bf-6be759ecec96 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:02.120798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1121/2222] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:02.122064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60056b-f4e3-42df-92bf-6be759ecec96 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:02.145500 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6014e8-b086-4740-8511-58ef1e2315f5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:02.152854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60056b-f4e3-42df-92bf-6be759ecec96 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:02.159640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a17216-f573-4f0b-a88e-fabe086900a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:02.160858 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:02.161112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17216-f573-4f0b-a88e-fabe086900a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:02.161562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17216-f573-4f0b-a88e-fabe086900a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:02.161747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:02.162089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:02.162368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] PATH_INFO: `/v3/users/42a60fd5d5fb45b594fb23dbca0917a3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:02.162607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a17216-f573-4f0b-a88e-fabe086900a6 admin admin] PATH_INFO: `/v3/projects/07c640b00c4341259670bbe22bcdf0c8/users/af12629dee2d4dda92d4b317468f155b/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:02.163589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a60fd5d5fb45b594fb23dbca0917a3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:02.165134 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a17216-f573-4f0b-a88e-fabe086900a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c640b00c4341259670bbe22bcdf0c8, user_id=af12629dee2d4dda92d4b317468f155b, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:02.165599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:02.169678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a17216-f573-4f0b-a88e-fabe086900a6 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:02.189687 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1122/2223] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:02 2022] PUT /identity/v3/projects/07c640b00c4341259670bbe22bcdf0c8/users/af12629dee2d4dda92d4b317468f155b/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:02.252143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a60fd5d5fb45b594fb23dbca0917a3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:02.253155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a60fd5d5fb45b594fb23dbca0917a3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:02.264521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a60fd5d5fb45b594fb23dbca0917a3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:02.273838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a60fd5d5fb45b594fb23dbca0917a3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:02.275220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a60fd5d5fb45b594fb23dbca0917a3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:02.302834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1102/2224] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:01 2022] DELETE /identity/v3/users/42a60fd5d5fb45b594fb23dbca0917a3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:02.304808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf9afe-d7bd-4ffe-9e82-b2808edfa85e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:02.305117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf9afe-d7bd-4ffe-9e82-b2808edfa85e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:02.305556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf9afe-d7bd-4ffe-9e82-b2808edfa85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:02.335635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c5cf9afe-d7bd-4ffe-9e82-b2808edfa85e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:02.339503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c5cf9afe-d7bd-4ffe-9e82-b2808edfa85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:02.350995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:02.470123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1123/2225] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:02.480472 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:02.481921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:02.608064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2517d-723c-472c-82b2-d5f2813f9773 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:02.623442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5a2a0-ba41-4943-8423-cb1523b715cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:02.624752 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5a2a0-ba41-4943-8423-cb1523b715cb service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:02.625044 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5a2a0-ba41-4943-8423-cb1523b715cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:02.625457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5a2a0-ba41-4943-8423-cb1523b715cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:02.639771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5a2a0-ba41-4943-8423-cb1523b715cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:02.641291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5a2a0-ba41-4943-8423-cb1523b715cb service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:02.663155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1103/2226] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:03.801193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf9afe-d7bd-4ffe-9e82-b2808edfa85e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:03.802652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c5cf9afe-d7bd-4ffe-9e82-b2808edfa85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:03.875334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5a2a0-ba41-4943-8423-cb1523b715cb service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:03.878501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cbd5a2a0-ba41-4943-8423-cb1523b715cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:03.904088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5a2a0-ba41-4943-8423-cb1523b715cb service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:03.911305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:03.912509 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:03.912979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:03.913401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] PATH_INFO: `/v3/projects/cf04dca30c5445bd84164651af96d49c` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:03.915785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf04dca30c5445bd84164651af96d49c)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:03.920027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:03.946102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf9afe-d7bd-4ffe-9e82-b2808edfa85e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:03.959370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf08781-b2ff-4a25-8343-3e5f5069532f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:03.961508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08781-b2ff-4a25-8343-3e5f5069532f service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:03.962020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08781-b2ff-4a25-8343-3e5f5069532f service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:03.962911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08781-b2ff-4a25-8343-3e5f5069532f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:03.968502 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-baf08781-b2ff-4a25-8343-3e5f5069532f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:04.007407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:04.036616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf04dca30c5445bd84164651af96d49c', 'request_id': 'req-3788290c-d7ac-4f4d-8135-c8318e7a2765'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:04.055475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf04dca30c5445bd84164651af96d49c', 'request_id': 'req-3788290c-d7ac-4f4d-8135-c8318e7a2765'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:04.073947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf04dca30c5445bd84164651af96d49c', 'request_id': 'req-3788290c-d7ac-4f4d-8135-c8318e7a2765'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:04.096841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] The token cache is being invalidate because project cf04dca30c5445bd84164651af96d49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:04.097164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:04.098537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:04.103687 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1104/2227] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:03 2022] DELETE /identity/v3/projects/cf04dca30c5445bd84164651af96d49c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:04.111976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:04.113988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:04.163752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf08781-b2ff-4a25-8343-3e5f5069532f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:04.169456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf08781-b2ff-4a25-8343-3e5f5069532f service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:04.209748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1124/2228] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:04.279056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788290c-d7ac-4f4d-8135-c8318e7a2765 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:04.290712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c95a9d-3bdd-46c5-9815-7f8e2cbd762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:04.292474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c95a9d-3bdd-46c5-9815-7f8e2cbd762d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:04.292769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c95a9d-3bdd-46c5-9815-7f8e2cbd762d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:04.293055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c95a9d-3bdd-46c5-9815-7f8e2cbd762d admin admin] PATH_INFO: `/v3/users/961a30020bc9431a9060b15403a1f0ce` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:04.294993 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c95a9d-3bdd-46c5-9815-7f8e2cbd762d admin admin] RBAC: Authorizing `identity:delete_user(user_id=961a30020bc9431a9060b15403a1f0ce)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:04.304728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c95a9d-3bdd-46c5-9815-7f8e2cbd762d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:04.421185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-82c95a9d-3bdd-46c5-9815-7f8e2cbd762d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961a30020bc9431a9060b15403a1f0ce'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:04.421876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-82c95a9d-3bdd-46c5-9815-7f8e2cbd762d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961a30020bc9431a9060b15403a1f0ce'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:04.447973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-82c95a9d-3bdd-46c5-9815-7f8e2cbd762d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961a30020bc9431a9060b15403a1f0ce'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:04.465779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-82c95a9d-3bdd-46c5-9815-7f8e2cbd762d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961a30020bc9431a9060b15403a1f0ce'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:04.466539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-82c95a9d-3bdd-46c5-9815-7f8e2cbd762d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961a30020bc9431a9060b15403a1f0ce'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:04.500663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1105/2229] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:04 2022] DELETE /identity/v3/users/961a30020bc9431a9060b15403a1f0ce => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:05.704166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf08781-b2ff-4a25-8343-3e5f5069532f service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:05.742443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf08781-b2ff-4a25-8343-3e5f5069532f service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:05.838249 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:05.840016 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:05.840698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:05.841239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] PATH_INFO: `/v3/projects/1ad529157ab24ce5ba95a2780d90c697` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:05.844843 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad529157ab24ce5ba95a2780d90c697)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:05.849053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:05.853598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:05.939001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad529157ab24ce5ba95a2780d90c697', 'request_id': 'req-7a234341-f2f8-4f71-a719-681037d1fcb6'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:05.949669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad529157ab24ce5ba95a2780d90c697', 'request_id': 'req-7a234341-f2f8-4f71-a719-681037d1fcb6'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:05.962739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad529157ab24ce5ba95a2780d90c697', 'request_id': 'req-7a234341-f2f8-4f71-a719-681037d1fcb6'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:05.994141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] The token cache is being invalidate because project 1ad529157ab24ce5ba95a2780d90c697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:05.994723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:05.996102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-7a234341-f2f8-4f71-a719-681037d1fcb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:05.999386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1125/2230] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:05 2022] DELETE /identity/v3/projects/1ad529157ab24ce5ba95a2780d90c697 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:06.005454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430115c-9cae-46ff-8a88-74f4731afe05 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.005995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430115c-9cae-46ff-8a88-74f4731afe05 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.005995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430115c-9cae-46ff-8a88-74f4731afe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.044800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-2430115c-9cae-46ff-8a88-74f4731afe05 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:06.046696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-2430115c-9cae-46ff-8a88-74f4731afe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:06.141580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:06.200542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1106/2231] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:06.202475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0b0b-c541-4c72-8403-33dd05ce096e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.202805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0b0b-c541-4c72-8403-33dd05ce096e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.203087 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c0b0b-c541-4c72-8403-33dd05ce096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.262529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-f22c0b0b-c541-4c72-8403-33dd05ce096e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:06.264592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f22c0b0b-c541-4c72-8403-33dd05ce096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:06.295403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1126/2232] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:06.296344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430115c-9cae-46ff-8a88-74f4731afe05 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:06.309766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430115c-9cae-46ff-8a88-74f4731afe05 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:06.324389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd1261-fd51-4510-994a-8ccbd48c5de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:06.326152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd1261-fd51-4510-994a-8ccbd48c5de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.327264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd1261-fd51-4510-994a-8ccbd48c5de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.327779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd1261-fd51-4510-994a-8ccbd48c5de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.331329 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd1261-fd51-4510-994a-8ccbd48c5de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:09:06.332976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd1261-fd51-4510-994a-8ccbd48c5de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:06.335461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd1261-fd51-4510-994a-8ccbd48c5de5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:06.362401 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c0b0b-c541-4c72-8403-33dd05ce096e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:06.381645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1107/2233] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:06.400180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c0b0b-c541-4c72-8403-33dd05ce096e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:06.413637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d858f-f282-442a-907b-4e49196b64cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:06.415036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d858f-f282-442a-907b-4e49196b64cf admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.415999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d858f-f282-442a-907b-4e49196b64cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.416433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d858f-f282-442a-907b-4e49196b64cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.418563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d858f-f282-442a-907b-4e49196b64cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:06.420860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d858f-f282-442a-907b-4e49196b64cf admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:06.503298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd1261-fd51-4510-994a-8ccbd48c5de5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:06.515205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1127/2234] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:06 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:06.521037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd1261-fd51-4510-994a-8ccbd48c5de5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:06.694153 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69f0f8-1585-4f45-8d6e-bd3076a00cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:06.694804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69f0f8-1585-4f45-8d6e-bd3076a00cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.696849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69f0f8-1585-4f45-8d6e-bd3076a00cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.697150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69f0f8-1585-4f45-8d6e-bd3076a00cdc admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.697875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69f0f8-1585-4f45-8d6e-bd3076a00cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:06.702718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69f0f8-1585-4f45-8d6e-bd3076a00cdc admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:06.762952 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d858f-f282-442a-907b-4e49196b64cf admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:06.773860 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1108/2235] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:06 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:06.789268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d858f-f282-442a-907b-4e49196b64cf admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:06.803263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3bbe3-0230-4046-915a-443ef151ae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:06.804464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3bbe3-0230-4046-915a-443ef151ae2b admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.806463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3bbe3-0230-4046-915a-443ef151ae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.806765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3bbe3-0230-4046-915a-443ef151ae2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.809137 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3bbe3-0230-4046-915a-443ef151ae2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:06.810812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3bbe3-0230-4046-915a-443ef151ae2b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:06.856925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1128/2236] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:09:06.861053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69f0f8-1585-4f45-8d6e-bd3076a00cdc admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:06.878908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69f0f8-1585-4f45-8d6e-bd3076a00cdc admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:06.895308 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772db532-16df-4da5-ad26-9398b6dba601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:06.895548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772db532-16df-4da5-ad26-9398b6dba601 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.895816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772db532-16df-4da5-ad26-9398b6dba601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.896295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772db532-16df-4da5-ad26-9398b6dba601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.897080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772db532-16df-4da5-ad26-9398b6dba601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:06.899143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772db532-16df-4da5-ad26-9398b6dba601 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:06.911436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1109/2237] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:06.915393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3bbe3-0230-4046-915a-443ef151ae2b admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:06.933506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3bbe3-0230-4046-915a-443ef151ae2b admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:06.946210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78ed91-304a-4bb4-97e0-5b0916d6c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:06.947131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78ed91-304a-4bb4-97e0-5b0916d6c1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:06.947423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78ed91-304a-4bb4-97e0-5b0916d6c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:06.947958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78ed91-304a-4bb4-97e0-5b0916d6c1b8 admin admin] PATH_INFO: `/v3/projects/ab92104a4079418ebdad648858ef2c1b/users/cbd2fdc095034b83a60ff6f6a262f7a8/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:06.985739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78ed91-304a-4bb4-97e0-5b0916d6c1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab92104a4079418ebdad648858ef2c1b, user_id=cbd2fdc095034b83a60ff6f6a262f7a8, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:06.994611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78ed91-304a-4bb4-97e0-5b0916d6c1b8 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:07.045289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1129/2238] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:06 2022] PUT /identity/v3/projects/ab92104a4079418ebdad648858ef2c1b/users/cbd2fdc095034b83a60ff6f6a262f7a8/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:07.059371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19636567-ba8c-4b84-a82f-fdea000c43cc None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:07.059951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19636567-ba8c-4b84-a82f-fdea000c43cc None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:07.062647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19636567-ba8c-4b84-a82f-fdea000c43cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:07.107152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-19636567-ba8c-4b84-a82f-fdea000c43cc None None] MFA Rules not processed for user `cbd2fdc095034b83a60ff6f6a262f7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:07.109785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-19636567-ba8c-4b84-a82f-fdea000c43cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:07.263471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1110/2239] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:07.268714 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78ed91-304a-4bb4-97e0-5b0916d6c1b8 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:07.467343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78ed91-304a-4bb4-97e0-5b0916d6c1b8 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:07.493334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefebbbd-4fca-4aa4-b5cf-2868ef13a072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:07.494518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefebbbd-4fca-4aa4-b5cf-2868ef13a072 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:07.495036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefebbbd-4fca-4aa4-b5cf-2868ef13a072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:07.495523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefebbbd-4fca-4aa4-b5cf-2868ef13a072 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:07.496522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefebbbd-4fca-4aa4-b5cf-2868ef13a072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:07.498766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefebbbd-4fca-4aa4-b5cf-2868ef13a072 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:07.577603 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1130/2240] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:07 2022] POST /identity/v3/projects => generated 381 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:09:07.579799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19636567-ba8c-4b84-a82f-fdea000c43cc None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:07.615744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19636567-ba8c-4b84-a82f-fdea000c43cc None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:07.805713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:07.840723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f4034-fbd9-4487-b196-5fafc3a7f488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:07.841414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f4034-fbd9-4487-b196-5fafc3a7f488 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:07.841702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f4034-fbd9-4487-b196-5fafc3a7f488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:07.842051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f4034-fbd9-4487-b196-5fafc3a7f488 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:07.842883 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f4034-fbd9-4487-b196-5fafc3a7f488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:07.845526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f4034-fbd9-4487-b196-5fafc3a7f488 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:07.892823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1111/2241] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:07 2022] POST /identity/v3/users => generated 297 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:07.896652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefebbbd-4fca-4aa4-b5cf-2868ef13a072 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:07.912630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefebbbd-4fca-4aa4-b5cf-2868ef13a072 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:07.929380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2aefc6-6e0d-43b9-9e2b-4ffbe7f38841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:07.930246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2aefc6-6e0d-43b9-9e2b-4ffbe7f38841 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:07.931168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2aefc6-6e0d-43b9-9e2b-4ffbe7f38841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:07.931539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2aefc6-6e0d-43b9-9e2b-4ffbe7f38841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:07.932415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2aefc6-6e0d-43b9-9e2b-4ffbe7f38841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:07.935404 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2aefc6-6e0d-43b9-9e2b-4ffbe7f38841 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:07.952982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:07.962622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1131/2242] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:07.966451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f4034-fbd9-4487-b196-5fafc3a7f488 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:07.983247 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f4034-fbd9-4487-b196-5fafc3a7f488 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:07.998679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056090f-7e8f-49ae-ba39-247ce304d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:07.999904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056090f-7e8f-49ae-ba39-247ce304d14d admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:08.000456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056090f-7e8f-49ae-ba39-247ce304d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:08.002004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056090f-7e8f-49ae-ba39-247ce304d14d admin admin] PATH_INFO: `/v3/projects/257483bb08e84725885426e700659089/users/b42750f3b68741b3a963b9bc52ac372a/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:08.043505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056090f-7e8f-49ae-ba39-247ce304d14d admin admin] RBAC: Authorizing `identity:create_grant(project_id=257483bb08e84725885426e700659089, user_id=b42750f3b68741b3a963b9bc52ac372a, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:08.050104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056090f-7e8f-49ae-ba39-247ce304d14d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:08.084046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1112/2243] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:07 2022] PUT /identity/v3/projects/257483bb08e84725885426e700659089/users/b42750f3b68741b3a963b9bc52ac372a/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:08.091133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2aefc6-6e0d-43b9-9e2b-4ffbe7f38841 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:08.119201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2aefc6-6e0d-43b9-9e2b-4ffbe7f38841 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:08.251294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b664c2-1f64-4d13-8710-6277883a7969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:08.251929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b664c2-1f64-4d13-8710-6277883a7969 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:08.252384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b664c2-1f64-4d13-8710-6277883a7969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:08.252651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b664c2-1f64-4d13-8710-6277883a7969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:08.253471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b664c2-1f64-4d13-8710-6277883a7969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:08.255424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b664c2-1f64-4d13-8710-6277883a7969 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:08.283434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1132/2244] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:08.285022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056090f-7e8f-49ae-ba39-247ce304d14d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:08.306588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056090f-7e8f-49ae-ba39-247ce304d14d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:08.312987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da29db-6f44-42ca-9535-80536cf1a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:08.313891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da29db-6f44-42ca-9535-80536cf1a4ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:08.314172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da29db-6f44-42ca-9535-80536cf1a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:08.314448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da29db-6f44-42ca-9535-80536cf1a4ac admin admin] PATH_INFO: `/v3/projects/257483bb08e84725885426e700659089/users/b42750f3b68741b3a963b9bc52ac372a/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:08.316485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da29db-6f44-42ca-9535-80536cf1a4ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=257483bb08e84725885426e700659089, user_id=b42750f3b68741b3a963b9bc52ac372a, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:08.320647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da29db-6f44-42ca-9535-80536cf1a4ac admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:08.350119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1113/2245] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:08 2022] PUT /identity/v3/projects/257483bb08e84725885426e700659089/users/b42750f3b68741b3a963b9bc52ac372a/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:08.352002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c64e6-2c87-4280-9ba0-b3d966942ac7 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:08.352854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c64e6-2c87-4280-9ba0-b3d966942ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:08.353205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c64e6-2c87-4280-9ba0-b3d966942ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:08.414409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-729c64e6-2c87-4280-9ba0-b3d966942ac7 None None] MFA Rules not processed for user `b42750f3b68741b3a963b9bc52ac372a`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:08.424755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-729c64e6-2c87-4280-9ba0-b3d966942ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:08.640159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1133/2246] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:08.656915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da29db-6f44-42ca-9535-80536cf1a4ac admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:08.659210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-45da29db-6f44-42ca-9535-80536cf1a4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:08.843754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da29db-6f44-42ca-9535-80536cf1a4ac admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:08.848869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237c899-8e15-4e0b-9db9-9d6c1884ac91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:08.849747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c899-8e15-4e0b-9db9-9d6c1884ac91 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:08.850397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c899-8e15-4e0b-9db9-9d6c1884ac91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:08.850819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c899-8e15-4e0b-9db9-9d6c1884ac91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:08.864300 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c899-8e15-4e0b-9db9-9d6c1884ac91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:08.866289 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c899-8e15-4e0b-9db9-9d6c1884ac91 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:08.887825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1114/2247] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:09.576698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c64e6-2c87-4280-9ba0-b3d966942ac7 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:09.597438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c64e6-2c87-4280-9ba0-b3d966942ac7 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:09.609255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9908eb-14b3-407e-ba3c-050b6da9e9e1 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42750f3b68741b3a963b9bc52ac372a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '257483bb08e84725885426e700659089', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:09.609957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9908eb-14b3-407e-ba3c-050b6da9e9e1 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:09.610342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9908eb-14b3-407e-ba3c-050b6da9e9e1 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:09.610518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9908eb-14b3-407e-ba3c-050b6da9e9e1 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:09.612158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9908eb-14b3-407e-ba3c-050b6da9e9e1 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:09:09.612521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9908eb-14b3-407e-ba3c-050b6da9e9e1 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:09.614178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9908eb-14b3-407e-ba3c-050b6da9e9e1 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:09.634696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1134/2248] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:09.636069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237c899-8e15-4e0b-9db9-9d6c1884ac91 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:09.652781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237c899-8e15-4e0b-9db9-9d6c1884ac91 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:09.661772 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993ba4c-ea97-43f0-ac7f-90be206c4029 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42750f3b68741b3a963b9bc52ac372a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '257483bb08e84725885426e700659089', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:09.664103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993ba4c-ea97-43f0-ac7f-90be206c4029 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:09.664665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993ba4c-ea97-43f0-ac7f-90be206c4029 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:09.665788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993ba4c-ea97-43f0-ac7f-90be206c4029 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:09.667063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993ba4c-ea97-43f0-ac7f-90be206c4029 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:09.670512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993ba4c-ea97-43f0-ac7f-90be206c4029 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:09.717596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1115/2249] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:09 2022] POST /identity/v3/projects => generated 353 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:09.721948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9908eb-14b3-407e-ba3c-050b6da9e9e1 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:09.741783 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9908eb-14b3-407e-ba3c-050b6da9e9e1 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:09.924221 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f91424-16c2-4f4f-ade9-f8815add1568 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42750f3b68741b3a963b9bc52ac372a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '257483bb08e84725885426e700659089', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:09.925153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f91424-16c2-4f4f-ade9-f8815add1568 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:09.926072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f91424-16c2-4f4f-ade9-f8815add1568 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:09.928011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f91424-16c2-4f4f-ade9-f8815add1568 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:09.928933 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f91424-16c2-4f4f-ade9-f8815add1568 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:09:09.930394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f91424-16c2-4f4f-ade9-f8815add1568 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:09.939553 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f91424-16c2-4f4f-ade9-f8815add1568 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:09.991082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1135/2250] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:10.060355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993ba4c-ea97-43f0-ac7f-90be206c4029 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:10.083436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993ba4c-ea97-43f0-ac7f-90be206c4029 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:10.098084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b42750f3b68741b3a963b9bc52ac372a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '257483bb08e84725885426e700659089', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:10.099250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:10.099545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:10.099826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] PATH_INFO: `/v3/projects/792bd8c8a00a4a86a548b8f6e790913e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:10.103884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: Authorizing `identity:delete_project(project_id=792bd8c8a00a4a86a548b8f6e790913e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:10.105884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:10.220778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792bd8c8a00a4a86a548b8f6e790913e', 'request_id': 'req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:10.236497 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792bd8c8a00a4a86a548b8f6e790913e', 'request_id': 'req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:10.251860 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792bd8c8a00a4a86a548b8f6e790913e', 'request_id': 'req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:10.254762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:10.277054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] The token cache is being invalidate because project 792bd8c8a00a4a86a548b8f6e790913e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:10.277620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:10.280115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9e2698e7-ef1b-4f9b-9c9f-ca5c316e8a46 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:10.282791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1116/2251] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:10 2022] DELETE /identity/v3/projects/792bd8c8a00a4a86a548b8f6e790913e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:10.695528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f91424-16c2-4f4f-ade9-f8815add1568 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:10.702429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-03f91424-16c2-4f4f-ade9-f8815add1568 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:10.712497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:10.882240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f91424-16c2-4f4f-ade9-f8815add1568 tempest-VolumeQuotaClassesTest-1661744784 tempest-VolumeQuotaClassesTest-1661744784-project-admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:11.082753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12d636-98e8-4e32-a072-bca1109fe703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:11.083814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12d636-98e8-4e32-a072-bca1109fe703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:11.084101 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12d636-98e8-4e32-a072-bca1109fe703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:11.084398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12d636-98e8-4e32-a072-bca1109fe703 admin admin] PATH_INFO: `/v3/users/cbd2fdc095034b83a60ff6f6a262f7a8` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:11.086126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12d636-98e8-4e32-a072-bca1109fe703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd2fdc095034b83a60ff6f6a262f7a8)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:11.091078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12d636-98e8-4e32-a072-bca1109fe703 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:11.234524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2b12d636-98e8-4e32-a072-bca1109fe703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd2fdc095034b83a60ff6f6a262f7a8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:11.251813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2b12d636-98e8-4e32-a072-bca1109fe703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd2fdc095034b83a60ff6f6a262f7a8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:11.255134 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2b12d636-98e8-4e32-a072-bca1109fe703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd2fdc095034b83a60ff6f6a262f7a8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:11.257310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2b12d636-98e8-4e32-a072-bca1109fe703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd2fdc095034b83a60ff6f6a262f7a8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:11.289356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2b12d636-98e8-4e32-a072-bca1109fe703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd2fdc095034b83a60ff6f6a262f7a8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:11.322574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1136/2252] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:10 2022] DELETE /identity/v3/users/cbd2fdc095034b83a60ff6f6a262f7a8 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:11.324256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c2f3-4cb7-4c9c-9a52-6f62d4962d53 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:11.324785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c2f3-4cb7-4c9c-9a52-6f62d4962d53 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:11.324865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c2f3-4cb7-4c9c-9a52-6f62d4962d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:11.365053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a826c2f3-4cb7-4c9c-9a52-6f62d4962d53 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:11.366306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a826c2f3-4cb7-4c9c-9a52-6f62d4962d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:11.437019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374785f6-6404-48eb-8fab-413b06c59346 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:11.437820 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374785f6-6404-48eb-8fab-413b06c59346 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:11.438108 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374785f6-6404-48eb-8fab-413b06c59346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:11.528630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-374785f6-6404-48eb-8fab-413b06c59346 None None] MFA Rules not processed for user `af12629dee2d4dda92d4b317468f155b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:11.530734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-374785f6-6404-48eb-8fab-413b06c59346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:11.533598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1117/2253] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:11.544011 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c2f3-4cb7-4c9c-9a52-6f62d4962d53 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:11.548450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a826c2f3-4cb7-4c9c-9a52-6f62d4962d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:11.604128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:11.786130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1137/2254] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:09:11.796017 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c2f3-4cb7-4c9c-9a52-6f62d4962d53 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:11.802537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374785f6-6404-48eb-8fab-413b06c59346 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:11.804145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-374785f6-6404-48eb-8fab-413b06c59346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:11.823776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d9c70-f658-49b8-9bb5-fcd966f32b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:11.825007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d9c70-f658-49b8-9bb5-fcd966f32b7c service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:11.827529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d9c70-f658-49b8-9bb5-fcd966f32b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:11.828630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d9c70-f658-49b8-9bb5-fcd966f32b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:11.861205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d9c70-f658-49b8-9bb5-fcd966f32b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:11.863291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d9c70-f658-49b8-9bb5-fcd966f32b7c service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:11.901167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1118/2255] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:09:11.949989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374785f6-6404-48eb-8fab-413b06c59346 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:11.955592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dac94-097f-4acc-8caa-9d103d8a1a85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f36041751a446885608f5a3b1f37df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:11.958976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dac94-097f-4acc-8caa-9d103d8a1a85 service glance] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:11.959266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dac94-097f-4acc-8caa-9d103d8a1a85 service glance] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:11.959549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5dac94-097f-4acc-8caa-9d103d8a1a85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:11.971424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4c5dac94-097f-4acc-8caa-9d103d8a1a85 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:12.076433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dac94-097f-4acc-8caa-9d103d8a1a85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:12.080505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5dac94-097f-4acc-8caa-9d103d8a1a85 service glance] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:12.096485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1138/2256] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:12.363058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4580b86-7b60-4bb0-9227-46b973c464df None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:12.363690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4580b86-7b60-4bb0-9227-46b973c464df None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:12.363690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4580b86-7b60-4bb0-9227-46b973c464df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:12.399459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b4580b86-7b60-4bb0-9227-46b973c464df None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:12.400620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b4580b86-7b60-4bb0-9227-46b973c464df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:12.453938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dac94-097f-4acc-8caa-9d103d8a1a85 service glance] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:12.455379 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4c5dac94-097f-4acc-8caa-9d103d8a1a85 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:12.478395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5dac94-097f-4acc-8caa-9d103d8a1a85 service glance] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:12.483738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:12.484723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:12.485631 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:12.485990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] PATH_INFO: `/v3/projects/ab92104a4079418ebdad648858ef2c1b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:12.496827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab92104a4079418ebdad648858ef2c1b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:12.504864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:12.539457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1119/2257] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:09:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:12.558611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4580b86-7b60-4bb0-9227-46b973c464df None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:12.560694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b4580b86-7b60-4bb0-9227-46b973c464df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:12.596304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab92104a4079418ebdad648858ef2c1b', 'request_id': 'req-610f069b-55c8-49d2-a0c1-25de4811440c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:12.602741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab92104a4079418ebdad648858ef2c1b', 'request_id': 'req-610f069b-55c8-49d2-a0c1-25de4811440c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:12.610333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab92104a4079418ebdad648858ef2c1b', 'request_id': 'req-610f069b-55c8-49d2-a0c1-25de4811440c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:12.613080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:12.625735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:12.639436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] The token cache is being invalidate because project ab92104a4079418ebdad648858ef2c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:12.639919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:12.640652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:12.642923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1139/2258] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:12 2022] DELETE /identity/v3/projects/ab92104a4079418ebdad648858ef2c1b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:09:12.646747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:12.648202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:12.653894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4580b86-7b60-4bb0-9227-46b973c464df None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:12.743035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f069b-55c8-49d2-a0c1-25de4811440c admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:12.790196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:12.793475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:12.793773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:12.804807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] PATH_INFO: `/v3/users/b42750f3b68741b3a963b9bc52ac372a` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:12.804807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42750f3b68741b3a963b9bc52ac372a)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:12.807724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:12.900008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d0133-dab7-46cd-b75e-61602ebf8428 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:12.900737 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d0133-dab7-46cd-b75e-61602ebf8428 service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:12.901028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d0133-dab7-46cd-b75e-61602ebf8428 service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:12.903133 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d0133-dab7-46cd-b75e-61602ebf8428 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:12.903311 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1a8d0133-dab7-46cd-b75e-61602ebf8428 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:13.037721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42750f3b68741b3a963b9bc52ac372a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:13.071833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42750f3b68741b3a963b9bc52ac372a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:13.072650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42750f3b68741b3a963b9bc52ac372a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:13.073294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42750f3b68741b3a963b9bc52ac372a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:13.110051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42750f3b68741b3a963b9bc52ac372a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:13.151734 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1140/2259] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:12 2022] DELETE /identity/v3/users/b42750f3b68741b3a963b9bc52ac372a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:09:13.174062 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d0133-dab7-46cd-b75e-61602ebf8428 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:13.175937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d0133-dab7-46cd-b75e-61602ebf8428 service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:13.187257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1120/2260] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:09:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 06:09:14.284239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:14.286340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:14.464070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ed8b2-bd74-42b3-b569-4ebd58f98ac6 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:14.475157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:14.476031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:14.476354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:14.476664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] PATH_INFO: `/v3/projects/257483bb08e84725885426e700659089` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:14.490358 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] RBAC: Authorizing `identity:delete_project(project_id=257483bb08e84725885426e700659089)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:14.492379 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:14.542753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:14.645950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257483bb08e84725885426e700659089', 'request_id': 'req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:14.662019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257483bb08e84725885426e700659089', 'request_id': 'req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:14.674764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257483bb08e84725885426e700659089', 'request_id': 'req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:14.702215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] The token cache is being invalidate because project 257483bb08e84725885426e700659089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:14.702577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:14.703911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8e63f867-85d1-45ae-8d3a-7b33b1bb928e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:14.710572 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1141/2261] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:14 2022] DELETE /identity/v3/projects/257483bb08e84725885426e700659089 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:14.715663 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c3ab-8c17-4a3c-860b-2aa05e45f74f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:14.716164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c3ab-8c17-4a3c-860b-2aa05e45f74f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:14.716244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785c3ab-8c17-4a3c-860b-2aa05e45f74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:14.769582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0785c3ab-8c17-4a3c-860b-2aa05e45f74f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:14.771238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0785c3ab-8c17-4a3c-860b-2aa05e45f74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:15.007622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1121/2262] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:15.012596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca85399-3561-435d-9d84-bc2de9ee678a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.013189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca85399-3561-435d-9d84-bc2de9ee678a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.014891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca85399-3561-435d-9d84-bc2de9ee678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.069917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-dca85399-3561-435d-9d84-bc2de9ee678a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:15.073622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-dca85399-3561-435d-9d84-bc2de9ee678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:15.097644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1142/2263] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:15.103626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785c3ab-8c17-4a3c-860b-2aa05e45f74f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:15.114697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785c3ab-8c17-4a3c-860b-2aa05e45f74f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:15.143291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa36795-2bcd-4a0c-b25c-2a6386c1c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:15.143981 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa36795-2bcd-4a0c-b25c-2a6386c1c6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.144268 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa36795-2bcd-4a0c-b25c-2a6386c1c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.144564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa36795-2bcd-4a0c-b25c-2a6386c1c6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.146631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa36795-2bcd-4a0c-b25c-2a6386c1c6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:09:15.146899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa36795-2bcd-4a0c-b25c-2a6386c1c6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:15.148587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa36795-2bcd-4a0c-b25c-2a6386c1c6d5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:15.213644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca85399-3561-435d-9d84-bc2de9ee678a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:15.219523 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1122/2264] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:15.226915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca85399-3561-435d-9d84-bc2de9ee678a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:15.281036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47a5d5-d998-441e-b5f2-a2bf995d72a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:15.281609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47a5d5-d998-441e-b5f2-a2bf995d72a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.281904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47a5d5-d998-441e-b5f2-a2bf995d72a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.282179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47a5d5-d998-441e-b5f2-a2bf995d72a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.282890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47a5d5-d998-441e-b5f2-a2bf995d72a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:15.284881 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47a5d5-d998-441e-b5f2-a2bf995d72a9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:15.346786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1143/2265] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:15 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:15.348887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa36795-2bcd-4a0c-b25c-2a6386c1c6d5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:15.383174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa36795-2bcd-4a0c-b25c-2a6386c1c6d5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:15.418002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:15.548529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cfbd1-6654-414e-91a0-43e57a36a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:15.548977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cfbd1-6654-414e-91a0-43e57a36a3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.549261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cfbd1-6654-414e-91a0-43e57a36a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.549543 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cfbd1-6654-414e-91a0-43e57a36a3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.550248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cfbd1-6654-414e-91a0-43e57a36a3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:15.552210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cfbd1-6654-414e-91a0-43e57a36a3d3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:15.610597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1123/2266] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:15 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:09:15.611809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47a5d5-d998-441e-b5f2-a2bf995d72a9 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:15.630902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47a5d5-d998-441e-b5f2-a2bf995d72a9 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:15.644185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e3c23-1896-45e9-a083-af0aae00813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:15.647064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e3c23-1896-45e9-a083-af0aae00813a admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.647364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e3c23-1896-45e9-a083-af0aae00813a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.647653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e3c23-1896-45e9-a083-af0aae00813a admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.648438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e3c23-1896-45e9-a083-af0aae00813a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:15.655782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e3c23-1896-45e9-a083-af0aae00813a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:15.712443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1144/2267] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:15.713761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cfbd1-6654-414e-91a0-43e57a36a3d3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:15.730052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cfbd1-6654-414e-91a0-43e57a36a3d3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:15.761102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5393b-cf5e-45c7-aecc-12420e913f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:15.761805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5393b-cf5e-45c7-aecc-12420e913f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.762085 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5393b-cf5e-45c7-aecc-12420e913f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.762638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5393b-cf5e-45c7-aecc-12420e913f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.763531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5393b-cf5e-45c7-aecc-12420e913f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:15.765644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5393b-cf5e-45c7-aecc-12420e913f8e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:15.834317 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e3c23-1896-45e9-a083-af0aae00813a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:15.845501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e3c23-1896-45e9-a083-af0aae00813a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:15.848925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1124/2268] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:15.893139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce4a02-f62e-43bc-ad6b-dc1e187cc9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:15.894338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce4a02-f62e-43bc-ad6b-dc1e187cc9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:15.902846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce4a02-f62e-43bc-ad6b-dc1e187cc9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:15.903413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce4a02-f62e-43bc-ad6b-dc1e187cc9d3 admin admin] PATH_INFO: `/v3/projects/cfd7ceaaa7c640cd85bd354e50e5e2b7/users/8f66adbfb0314569bdae47af814e548d/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:15.945335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce4a02-f62e-43bc-ad6b-dc1e187cc9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd7ceaaa7c640cd85bd354e50e5e2b7, user_id=8f66adbfb0314569bdae47af814e548d, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:15.948415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce4a02-f62e-43bc-ad6b-dc1e187cc9d3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:16.043498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1145/2269] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:15 2022] PUT /identity/v3/projects/cfd7ceaaa7c640cd85bd354e50e5e2b7/users/8f66adbfb0314569bdae47af814e548d/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:16.101670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09167d-1215-4e4e-bd3b-0a2698094ca0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:16.102403 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09167d-1215-4e4e-bd3b-0a2698094ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:16.102908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09167d-1215-4e4e-bd3b-0a2698094ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:16.221421 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cf09167d-1215-4e4e-bd3b-0a2698094ca0 None None] MFA Rules not processed for user `8f66adbfb0314569bdae47af814e548d`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:16.223182 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cf09167d-1215-4e4e-bd3b-0a2698094ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:16.513276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce4a02-f62e-43bc-ad6b-dc1e187cc9d3 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:16.520478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1125/2270] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:16.683521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce4a02-f62e-43bc-ad6b-dc1e187cc9d3 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:16.699925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69589d-9f95-415c-9e79-81a63dae44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:16.701170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69589d-9f95-415c-9e79-81a63dae44b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:16.701170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69589d-9f95-415c-9e79-81a63dae44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:16.701170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69589d-9f95-415c-9e79-81a63dae44b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:16.710292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69589d-9f95-415c-9e79-81a63dae44b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:16.717046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69589d-9f95-415c-9e79-81a63dae44b2 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:16.777887 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1146/2271] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:16 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:16.780739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09167d-1215-4e4e-bd3b-0a2698094ca0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:16.813722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09167d-1215-4e4e-bd3b-0a2698094ca0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:17.220214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71942f14-19f9-4bb1-9dc4-4417c7e1ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:17.223436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71942f14-19f9-4bb1-9dc4-4417c7e1ad01 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:17.225714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71942f14-19f9-4bb1-9dc4-4417c7e1ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:17.226144 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71942f14-19f9-4bb1-9dc4-4417c7e1ad01 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:17.227884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71942f14-19f9-4bb1-9dc4-4417c7e1ad01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:17.240665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71942f14-19f9-4bb1-9dc4-4417c7e1ad01 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:17.331662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69589d-9f95-415c-9e79-81a63dae44b2 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:17.332337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1126/2272] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:16 2022] POST /identity/v3/users => generated 294 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:17.354595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69589d-9f95-415c-9e79-81a63dae44b2 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:17.389331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d007e1-503e-4691-ae99-68125bf9e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:17.391473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d007e1-503e-4691-ae99-68125bf9e2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:17.391943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d007e1-503e-4691-ae99-68125bf9e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:17.392409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d007e1-503e-4691-ae99-68125bf9e2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:17.393331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d007e1-503e-4691-ae99-68125bf9e2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:17.403830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d007e1-503e-4691-ae99-68125bf9e2b2 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:17.441758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1147/2273] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:09:17.446053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71942f14-19f9-4bb1-9dc4-4417c7e1ad01 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:17.480465 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71942f14-19f9-4bb1-9dc4-4417c7e1ad01 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:17.510737 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6f25e-9721-42ea-aa69-0056c9f8b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:17.511428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f25e-9721-42ea-aa69-0056c9f8b036 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:17.511712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f25e-9721-42ea-aa69-0056c9f8b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:17.516190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6f25e-9721-42ea-aa69-0056c9f8b036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:17.517210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6f25e-9721-42ea-aa69-0056c9f8b036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:17.528282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6f25e-9721-42ea-aa69-0056c9f8b036 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:17.583724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d007e1-503e-4691-ae99-68125bf9e2b2 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:17.584748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1127/2274] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:17.605275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d007e1-503e-4691-ae99-68125bf9e2b2 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:17.651072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea59df-d0de-41d6-bb5b-c83d9dd43712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:17.656642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea59df-d0de-41d6-bb5b-c83d9dd43712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:17.656978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea59df-d0de-41d6-bb5b-c83d9dd43712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:17.657276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea59df-d0de-41d6-bb5b-c83d9dd43712 admin admin] PATH_INFO: `/v3/projects/bcca67b28e2d4a0e8a1175bf01ad554d/users/95ca39be6089441b8c7909bf8050736f/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:17.679782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:17.698164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea59df-d0de-41d6-bb5b-c83d9dd43712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcca67b28e2d4a0e8a1175bf01ad554d, user_id=95ca39be6089441b8c7909bf8050736f, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:17.718840 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea59df-d0de-41d6-bb5b-c83d9dd43712 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:17.767941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1148/2275] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:17 2022] PUT /identity/v3/projects/bcca67b28e2d4a0e8a1175bf01ad554d/users/95ca39be6089441b8c7909bf8050736f/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:17.781117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1978-2572-41e4-a213-b912d690b98a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:17.781681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1978-2572-41e4-a213-b912d690b98a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:17.781681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1978-2572-41e4-a213-b912d690b98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:17.825184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:17.862066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-10cc1978-2572-41e4-a213-b912d690b98a None None] MFA Rules not processed for user `95ca39be6089441b8c7909bf8050736f`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:17.864991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-10cc1978-2572-41e4-a213-b912d690b98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:17.982630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1128/2276] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:17.983812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea59df-d0de-41d6-bb5b-c83d9dd43712 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:18.156042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea59df-d0de-41d6-bb5b-c83d9dd43712 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:18.163282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700fe8c-b5be-4f6b-8f8e-73161b092d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:18.166438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700fe8c-b5be-4f6b-8f8e-73161b092d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:18.166950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700fe8c-b5be-4f6b-8f8e-73161b092d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:18.167801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700fe8c-b5be-4f6b-8f8e-73161b092d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:18.169105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700fe8c-b5be-4f6b-8f8e-73161b092d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:18.172165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700fe8c-b5be-4f6b-8f8e-73161b092d5e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:18.243014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1149/2277] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:17 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:18.247913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1978-2572-41e4-a213-b912d690b98a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:18.284090 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1978-2572-41e4-a213-b912d690b98a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:18.485395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a133bc-dac9-4c04-9d41-af3496db3d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:18.486445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a133bc-dac9-4c04-9d41-af3496db3d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:18.488139 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a133bc-dac9-4c04-9d41-af3496db3d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:18.491158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a133bc-dac9-4c04-9d41-af3496db3d19 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:18.492171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a133bc-dac9-4c04-9d41-af3496db3d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:18.495297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a133bc-dac9-4c04-9d41-af3496db3d19 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:18.569586 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700fe8c-b5be-4f6b-8f8e-73161b092d5e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:18.593249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1129/2278] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:18 2022] POST /identity/v3/users => generated 298 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:18.616740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700fe8c-b5be-4f6b-8f8e-73161b092d5e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:18.644122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d10ca0-ecf5-42d8-b7eb-64014acb184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:18.645277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d10ca0-ecf5-42d8-b7eb-64014acb184b admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:18.645646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d10ca0-ecf5-42d8-b7eb-64014acb184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:18.649656 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d10ca0-ecf5-42d8-b7eb-64014acb184b admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:18.651471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d10ca0-ecf5-42d8-b7eb-64014acb184b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:18.660999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d10ca0-ecf5-42d8-b7eb-64014acb184b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:18.679750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1150/2279] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:18.685482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a133bc-dac9-4c04-9d41-af3496db3d19 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:18.698497 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a133bc-dac9-4c04-9d41-af3496db3d19 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:18.704177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04169caf-6d1f-4707-aa4b-d146f1bb503b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:18.705428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04169caf-6d1f-4707-aa4b-d146f1bb503b admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:18.705718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04169caf-6d1f-4707-aa4b-d146f1bb503b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:18.705995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04169caf-6d1f-4707-aa4b-d146f1bb503b admin admin] PATH_INFO: `/v3/projects/2cc879adf0b041c198bb4fc9fe94312d/users/af0885fbf7b64116884200aade01ab9e/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:18.725934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04169caf-6d1f-4707-aa4b-d146f1bb503b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc879adf0b041c198bb4fc9fe94312d, user_id=af0885fbf7b64116884200aade01ab9e, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:18.733592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04169caf-6d1f-4707-aa4b-d146f1bb503b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:18.778348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1130/2280] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:18 2022] PUT /identity/v3/projects/2cc879adf0b041c198bb4fc9fe94312d/users/af0885fbf7b64116884200aade01ab9e/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:18.782283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d10ca0-ecf5-42d8-b7eb-64014acb184b admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:18.797879 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d10ca0-ecf5-42d8-b7eb-64014acb184b admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:18.972367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3044b1-90ea-41ba-9f4e-fcccd1354fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:18.973065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3044b1-90ea-41ba-9f4e-fcccd1354fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:18.973479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3044b1-90ea-41ba-9f4e-fcccd1354fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:18.974060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3044b1-90ea-41ba-9f4e-fcccd1354fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:18.974652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3044b1-90ea-41ba-9f4e-fcccd1354fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:18.976305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3044b1-90ea-41ba-9f4e-fcccd1354fe7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:19.011310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1151/2281] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:19.012612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04169caf-6d1f-4707-aa4b-d146f1bb503b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:19.026451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04169caf-6d1f-4707-aa4b-d146f1bb503b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:19.045723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34841a-0115-4a6a-8ad0-3ab0b634a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:19.046800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34841a-0115-4a6a-8ad0-3ab0b634a2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:19.047077 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34841a-0115-4a6a-8ad0-3ab0b634a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:19.047365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34841a-0115-4a6a-8ad0-3ab0b634a2a9 admin admin] PATH_INFO: `/v3/projects/2cc879adf0b041c198bb4fc9fe94312d/users/af0885fbf7b64116884200aade01ab9e/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:19.057475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34841a-0115-4a6a-8ad0-3ab0b634a2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc879adf0b041c198bb4fc9fe94312d, user_id=af0885fbf7b64116884200aade01ab9e, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:19.065208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34841a-0115-4a6a-8ad0-3ab0b634a2a9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:19.126975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1131/2282] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:19 2022] PUT /identity/v3/projects/2cc879adf0b041c198bb4fc9fe94312d/users/af0885fbf7b64116884200aade01ab9e/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:19.138313 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01968-e101-4ab6-b816-1ee78ac70bcd None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:19.138650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01968-e101-4ab6-b816-1ee78ac70bcd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:19.139172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01968-e101-4ab6-b816-1ee78ac70bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:19.243864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-e1e01968-e101-4ab6-b816-1ee78ac70bcd None None] MFA Rules not processed for user `af0885fbf7b64116884200aade01ab9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:19.246345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e1e01968-e101-4ab6-b816-1ee78ac70bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:19.459997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:19.525726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1152/2283] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:19.540029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34841a-0115-4a6a-8ad0-3ab0b634a2a9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:19.541857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ef34841a-0115-4a6a-8ad0-3ab0b634a2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:19.710519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:19.736641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34841a-0115-4a6a-8ad0-3ab0b634a2a9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:19.753786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929c4df-4e84-4d38-9056-274f5249a609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:19.754467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c4df-4e84-4d38-9056-274f5249a609 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:19.754754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c4df-4e84-4d38-9056-274f5249a609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:19.755036 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c4df-4e84-4d38-9056-274f5249a609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:19.811213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929c4df-4e84-4d38-9056-274f5249a609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:19.812743 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929c4df-4e84-4d38-9056-274f5249a609 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:19.874780 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1132/2284] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:20.951313 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c922f-f694-436f-b28b-dd3ce9c2e59e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:20.951862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c922f-f694-436f-b28b-dd3ce9c2e59e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:20.951862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c922f-f694-436f-b28b-dd3ce9c2e59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:20.998753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-0f0c922f-f694-436f-b28b-dd3ce9c2e59e None None] MFA Rules not processed for user `c2b89a9466d848529893af51e99be1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:21.000004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0f0c922f-f694-436f-b28b-dd3ce9c2e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:21.103243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929c4df-4e84-4d38-9056-274f5249a609 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:21.112386 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929c4df-4e84-4d38-9056-274f5249a609 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:21.124998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57befa-e674-426c-a868-3cf261e06664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:21.125674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57befa-e674-426c-a868-3cf261e06664 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:21.125958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57befa-e674-426c-a868-3cf261e06664 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:21.126233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57befa-e674-426c-a868-3cf261e06664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:21.174866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1153/2285] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:21.362453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57befa-e674-426c-a868-3cf261e06664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:21.364078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57befa-e674-426c-a868-3cf261e06664 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:21.394576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1133/2286] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:09:26.521196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c922f-f694-436f-b28b-dd3ce9c2e59e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:26.522928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0f0c922f-f694-436f-b28b-dd3ce9c2e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:26.540901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c922f-f694-436f-b28b-dd3ce9c2e59e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:26.545202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef628ff-6c57-4170-8dbd-d64b1b744e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:26.546225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef628ff-6c57-4170-8dbd-d64b1b744e0e service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:26.546697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef628ff-6c57-4170-8dbd-d64b1b744e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:26.547170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef628ff-6c57-4170-8dbd-d64b1b744e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:26.629975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef628ff-6c57-4170-8dbd-d64b1b744e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:26.631782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef628ff-6c57-4170-8dbd-d64b1b744e0e service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:26.645273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1154/2287] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:27.053736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47ad4-947a-49c9-8371-59e359a9f92e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:27.054283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47ad4-947a-49c9-8371-59e359a9f92e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:27.054627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47ad4-947a-49c9-8371-59e359a9f92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:27.091833 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5dc47ad4-947a-49c9-8371-59e359a9f92e None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:27.095292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5dc47ad4-947a-49c9-8371-59e359a9f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:27.223528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1134/2288] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 20 06:09:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:27.264769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef628ff-6c57-4170-8dbd-d64b1b744e0e service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:27.267031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-aef628ff-6c57-4170-8dbd-d64b1b744e0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:27.488421 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef628ff-6c57-4170-8dbd-d64b1b744e0e service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:27.502475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a7ec4-f00e-4f95-93ad-b6948f4c1962 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:27.503175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a7ec4-f00e-4f95-93ad-b6948f4c1962 service swift] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:27.504500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a7ec4-f00e-4f95-93ad-b6948f4c1962 service swift] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:27.504819 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a7ec4-f00e-4f95-93ad-b6948f4c1962 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:27.526371 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a7ec4-f00e-4f95-93ad-b6948f4c1962 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:27.530294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a7ec4-f00e-4f95-93ad-b6948f4c1962 service swift] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:27.553549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1155/2289] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:09:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:09:29.403444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d97ab-0f21-4eeb-baee-d63a23871dcf None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:29.404003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d97ab-0f21-4eeb-baee-d63a23871dcf None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:29.404003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d97ab-0f21-4eeb-baee-d63a23871dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:29.432125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f08d97ab-0f21-4eeb-baee-d63a23871dcf None None] MFA Rules not processed for user `0883c5f7ca2f4f49b99e85350b5ca526`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:29.435541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f08d97ab-0f21-4eeb-baee-d63a23871dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:29.493909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a7ec4-f00e-4f95-93ad-b6948f4c1962 service swift] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:29.578506 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1135/2290] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:09:29.583267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:29.660203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a7ec4-f00e-4f95-93ad-b6948f4c1962 service swift] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:29.667808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209c927-a434-4244-82f2-e7a2e7f5b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:29.669985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c927-a434-4244-82f2-e7a2e7f5b6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:29.670589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c927-a434-4244-82f2-e7a2e7f5b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:29.671323 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209c927-a434-4244-82f2-e7a2e7f5b6de admin admin] PATH_INFO: `/v3/users/8f66adbfb0314569bdae47af814e548d` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:29.673079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209c927-a434-4244-82f2-e7a2e7f5b6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f66adbfb0314569bdae47af814e548d)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:29.675344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209c927-a434-4244-82f2-e7a2e7f5b6de admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:29.804682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b209c927-a434-4244-82f2-e7a2e7f5b6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f66adbfb0314569bdae47af814e548d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:29.821645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b209c927-a434-4244-82f2-e7a2e7f5b6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f66adbfb0314569bdae47af814e548d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:29.823510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b209c927-a434-4244-82f2-e7a2e7f5b6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f66adbfb0314569bdae47af814e548d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:29.829066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b209c927-a434-4244-82f2-e7a2e7f5b6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f66adbfb0314569bdae47af814e548d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:29.848732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c18d9-ac8f-4fc2-a0e4-ef41201217dd None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:29.849327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c18d9-ac8f-4fc2-a0e4-ef41201217dd None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:29.850087 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c18d9-ac8f-4fc2-a0e4-ef41201217dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:29.877695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b209c927-a434-4244-82f2-e7a2e7f5b6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f66adbfb0314569bdae47af814e548d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:29.886590 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-985c18d9-ac8f-4fc2-a0e4-ef41201217dd None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:29.891099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-985c18d9-ac8f-4fc2-a0e4-ef41201217dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:29.905260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1156/2291] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:29 2022] DELETE /identity/v3/users/8f66adbfb0314569bdae47af814e548d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:29.911178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7bd88-09c1-45b0-ae06-d8fbd620ec3e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:29.911481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7bd88-09c1-45b0-ae06-d8fbd620ec3e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:29.911960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7bd88-09c1-45b0-ae06-d8fbd620ec3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:29.918896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1136/2292] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:09:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:29.933086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c18d9-ac8f-4fc2-a0e4-ef41201217dd None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:29.935043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-985c18d9-ac8f-4fc2-a0e4-ef41201217dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:29.946327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-5cb7bd88-09c1-45b0-ae06-d8fbd620ec3e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:29.948473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5cb7bd88-09c1-45b0-ae06-d8fbd620ec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:29.957463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c18d9-ac8f-4fc2-a0e4-ef41201217dd None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:30.005541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:30.041627 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1157/2293] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:30.063771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ae71-7c4a-4f50-9c57-8d64034de5fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:30.064778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ae71-7c4a-4f50-9c57-8d64034de5fc service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:30.065281 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7bd88-09c1-45b0-ae06-d8fbd620ec3e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:30.065744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ae71-7c4a-4f50-9c57-8d64034de5fc service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:30.066794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ae71-7c4a-4f50-9c57-8d64034de5fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:30.068605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5cb7bd88-09c1-45b0-ae06-d8fbd620ec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:30.160818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ae71-7c4a-4f50-9c57-8d64034de5fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:30.162859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ae71-7c4a-4f50-9c57-8d64034de5fc service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:30.176669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:30.190205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1137/2294] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:09:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 06:09:30.215740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7bd88-09c1-45b0-ae06-d8fbd620ec3e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:30.229347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a79cf-bb01-43c6-9160-becd91a39af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:30.229888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a79cf-bb01-43c6-9160-becd91a39af5 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:30.239777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a79cf-bb01-43c6-9160-becd91a39af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:30.239914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a79cf-bb01-43c6-9160-becd91a39af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:30.267334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a79cf-bb01-43c6-9160-becd91a39af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:30.269539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a79cf-bb01-43c6-9160-becd91a39af5 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:30.283768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1158/2295] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:09:30.489385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ae71-7c4a-4f50-9c57-8d64034de5fc service swift] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:30.493004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3088ae71-7c4a-4f50-9c57-8d64034de5fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:30.528632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ae71-7c4a-4f50-9c57-8d64034de5fc service swift] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:30.534610 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d6a5-7132-43a2-91b0-d18dca02f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:30.535811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d6a5-7132-43a2-91b0-d18dca02f845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:30.536099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d6a5-7132-43a2-91b0-d18dca02f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:30.536398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d6a5-7132-43a2-91b0-d18dca02f845 admin admin] PATH_INFO: `/v3/users/2525ac7476134b47956db1c6f5719498` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:30.537893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94d6a5-7132-43a2-91b0-d18dca02f845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2525ac7476134b47956db1c6f5719498)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:30.540727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94d6a5-7132-43a2-91b0-d18dca02f845 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:30.614092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0b94d6a5-7132-43a2-91b0-d18dca02f845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2525ac7476134b47956db1c6f5719498'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:30.616211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0b94d6a5-7132-43a2-91b0-d18dca02f845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2525ac7476134b47956db1c6f5719498'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:30.630069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0b94d6a5-7132-43a2-91b0-d18dca02f845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2525ac7476134b47956db1c6f5719498'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:30.640909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0b94d6a5-7132-43a2-91b0-d18dca02f845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2525ac7476134b47956db1c6f5719498'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:30.642027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-0b94d6a5-7132-43a2-91b0-d18dca02f845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2525ac7476134b47956db1c6f5719498'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:30.677679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1138/2296] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:30 2022] DELETE /identity/v3/users/2525ac7476134b47956db1c6f5719498 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:30.948248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a79cf-bb01-43c6-9160-becd91a39af5 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:30.966822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a79cf-bb01-43c6-9160-becd91a39af5 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:31.089431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:31.090989 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.091992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.092301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] PATH_INFO: `/v3/projects/b397fe0cfde44535b2de63ae69fdf3da` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.093856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b397fe0cfde44535b2de63ae69fdf3da)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:31.097171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:31.179510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b397fe0cfde44535b2de63ae69fdf3da', 'request_id': 'req-67e13f90-dec6-417d-9ec2-47127fef965d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:31.193231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b397fe0cfde44535b2de63ae69fdf3da', 'request_id': 'req-67e13f90-dec6-417d-9ec2-47127fef965d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:31.210935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b397fe0cfde44535b2de63ae69fdf3da', 'request_id': 'req-67e13f90-dec6-417d-9ec2-47127fef965d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:31.258292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] The token cache is being invalidate because project b397fe0cfde44535b2de63ae69fdf3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:31.258599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:31.261273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-67e13f90-dec6-417d-9ec2-47127fef965d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:31.265718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1159/2297] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:30 2022] DELETE /identity/v3/projects/b397fe0cfde44535b2de63ae69fdf3da => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:31.274734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751e3f2-17ad-4ce5-b24d-5833c4028cfb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.275016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751e3f2-17ad-4ce5-b24d-5833c4028cfb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.275310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751e3f2-17ad-4ce5-b24d-5833c4028cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.307165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f751e3f2-17ad-4ce5-b24d-5833c4028cfb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:31.308005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f751e3f2-17ad-4ce5-b24d-5833c4028cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:31.356204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:31.400910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b88d4-c15c-4249-a77e-8240c5442abb None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.401214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b88d4-c15c-4249-a77e-8240c5442abb None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.401501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b88d4-c15c-4249-a77e-8240c5442abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.410770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1139/2298] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:31.423266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-435b88d4-c15c-4249-a77e-8240c5442abb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:31.424570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-435b88d4-c15c-4249-a77e-8240c5442abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:31.439541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751e3f2-17ad-4ce5-b24d-5833c4028cfb None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:31.450939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1160/2299] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:31.451393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751e3f2-17ad-4ce5-b24d-5833c4028cfb None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:31.456841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fa578-6c06-4d8e-a3bb-61c50d466b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:31.457519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fa578-6c06-4d8e-a3bb-61c50d466b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.457882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fa578-6c06-4d8e-a3bb-61c50d466b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.458166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201fa578-6c06-4d8e-a3bb-61c50d466b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.458909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fa578-6c06-4d8e-a3bb-61c50d466b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:09:31.459225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fa578-6c06-4d8e-a3bb-61c50d466b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:31.461520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201fa578-6c06-4d8e-a3bb-61c50d466b9c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:31.476033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1140/2300] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:31.481466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b88d4-c15c-4249-a77e-8240c5442abb None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:31.497748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b88d4-c15c-4249-a77e-8240c5442abb None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:31.504291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd74ced-b7e2-491e-a438-2d0f5263e5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:31.505624 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd74ced-b7e2-491e-a438-2d0f5263e5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.506029 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd74ced-b7e2-491e-a438-2d0f5263e5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.506235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd74ced-b7e2-491e-a438-2d0f5263e5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.511300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd74ced-b7e2-491e-a438-2d0f5263e5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:31.513332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd74ced-b7e2-491e-a438-2d0f5263e5a3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:31.561891 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fa578-6c06-4d8e-a3bb-61c50d466b9c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:31.572889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1161/2301] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:31 2022] POST /identity/v3/projects => generated 369 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:31.574814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201fa578-6c06-4d8e-a3bb-61c50d466b9c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:31.687073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054f6a-1cea-42f2-88d6-e520cdbe6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:31.687981 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054f6a-1cea-42f2-88d6-e520cdbe6db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.692504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054f6a-1cea-42f2-88d6-e520cdbe6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.692800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054f6a-1cea-42f2-88d6-e520cdbe6db4 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.693561 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1054f6a-1cea-42f2-88d6-e520cdbe6db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:31.697267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1054f6a-1cea-42f2-88d6-e520cdbe6db4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:31.736763 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd74ced-b7e2-491e-a438-2d0f5263e5a3 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:31.746388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1141/2302] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:31 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:31.764857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd74ced-b7e2-491e-a438-2d0f5263e5a3 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:31.772639 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab469-6615-473e-9001-c8c58d211c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:31.773518 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab469-6615-473e-9001-c8c58d211c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.774395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab469-6615-473e-9001-c8c58d211c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.774789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab469-6615-473e-9001-c8c58d211c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.775662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daab469-6615-473e-9001-c8c58d211c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:31.777827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daab469-6615-473e-9001-c8c58d211c90 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:31.795204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054f6a-1cea-42f2-88d6-e520cdbe6db4 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:31.802726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1162/2303] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:31.811787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054f6a-1cea-42f2-88d6-e520cdbe6db4 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:31.819051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb2cbb-c8ab-4fc7-a5e8-7166a6f3190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:31.819881 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb2cbb-c8ab-4fc7-a5e8-7166a6f3190f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.820244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb2cbb-c8ab-4fc7-a5e8-7166a6f3190f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.821047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb2cbb-c8ab-4fc7-a5e8-7166a6f3190f admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.821847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb2cbb-c8ab-4fc7-a5e8-7166a6f3190f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:31.823488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb2cbb-c8ab-4fc7-a5e8-7166a6f3190f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:31.839175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1142/2304] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:31.843764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab469-6615-473e-9001-c8c58d211c90 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:31.863336 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab469-6615-473e-9001-c8c58d211c90 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:31.876116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f52d7-996f-429e-a3d4-0df1683280f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:31.877609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f52d7-996f-429e-a3d4-0df1683280f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.877609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f52d7-996f-429e-a3d4-0df1683280f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.877609 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f52d7-996f-429e-a3d4-0df1683280f1 admin admin] PATH_INFO: `/v3/projects/71ba5a1e5b72497cab8c582c3f539acc/users/fcea4a42269949f5b2b21f2613985041/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.914383 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f52d7-996f-429e-a3d4-0df1683280f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ba5a1e5b72497cab8c582c3f539acc, user_id=fcea4a42269949f5b2b21f2613985041, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:31.917299 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f52d7-996f-429e-a3d4-0df1683280f1 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:31.948855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3ff1-ee29-44b6-aeac-1507fe1cdaea None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:31.949189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3ff1-ee29-44b6-aeac-1507fe1cdaea None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:31.949360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3ff1-ee29-44b6-aeac-1507fe1cdaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:31.950848 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1163/2305] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:31 2022] PUT /identity/v3/projects/71ba5a1e5b72497cab8c582c3f539acc/users/fcea4a42269949f5b2b21f2613985041/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:31.996726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-540f3ff1-ee29-44b6-aeac-1507fe1cdaea None None] MFA Rules not processed for user `fcea4a42269949f5b2b21f2613985041`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:31.998232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-540f3ff1-ee29-44b6-aeac-1507fe1cdaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:32.137105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1143/2306] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:32.149882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f52d7-996f-429e-a3d4-0df1683280f1 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:32.151863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e99f52d7-996f-429e-a3d4-0df1683280f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:32.159909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:32.274866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f52d7-996f-429e-a3d4-0df1683280f1 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:32.286041 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845abeb2-c444-4d16-bb09-b326129b28ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f36041751a446885608f5a3b1f37df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:32.289784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845abeb2-c444-4d16-bb09-b326129b28ff service glance] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:32.290088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845abeb2-c444-4d16-bb09-b326129b28ff service glance] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:32.291302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845abeb2-c444-4d16-bb09-b326129b28ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:32.308614 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845abeb2-c444-4d16-bb09-b326129b28ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:32.310227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845abeb2-c444-4d16-bb09-b326129b28ff service glance] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:32.371233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1164/2307] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:32.844988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f3ff1-ee29-44b6-aeac-1507fe1cdaea None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:32.848262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-540f3ff1-ee29-44b6-aeac-1507fe1cdaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:32.854110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845abeb2-c444-4d16-bb09-b326129b28ff service glance] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:32.856648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-845abeb2-c444-4d16-bb09-b326129b28ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:33.011050 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:33.037841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845abeb2-c444-4d16-bb09-b326129b28ff service glance] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:33.045085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:33.046508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:33.047131 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:33.047754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] PATH_INFO: `/v3/users/cd9b0488ff9c4f2bb1a50916b205ba11` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:33.049851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9b0488ff9c4f2bb1a50916b205ba11)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:33.052436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:33.088604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f3ff1-ee29-44b6-aeac-1507fe1cdaea None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:33.118267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:33.120114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:33.120468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:33.120905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] PATH_INFO: `/v3/projects/cfd7ceaaa7c640cd85bd354e50e5e2b7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:33.122720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd7ceaaa7c640cd85bd354e50e5e2b7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:33.128025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:33.171707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9b0488ff9c4f2bb1a50916b205ba11'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.189987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9b0488ff9c4f2bb1a50916b205ba11'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.191111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9b0488ff9c4f2bb1a50916b205ba11'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.194082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9b0488ff9c4f2bb1a50916b205ba11'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.224444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9b0488ff9c4f2bb1a50916b205ba11'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.253511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd7ceaaa7c640cd85bd354e50e5e2b7', 'request_id': 'req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.259257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1165/2308] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:32 2022] DELETE /identity/v3/users/cd9b0488ff9c4f2bb1a50916b205ba11 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:33.270457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd7ceaaa7c640cd85bd354e50e5e2b7', 'request_id': 'req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.282136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd7ceaaa7c640cd85bd354e50e5e2b7', 'request_id': 'req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.303761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] The token cache is being invalidate because project cfd7ceaaa7c640cd85bd354e50e5e2b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:33.304148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.305359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.307437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1144/2309] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:32 2022] DELETE /identity/v3/projects/cfd7ceaaa7c640cd85bd354e50e5e2b7 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:33.311516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:33.313371 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:33.394562 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:33.527464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d9a5a-b6ca-438b-ab43-77da53b1b05a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:33.536962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:33.537873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:33.538162 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:33.538441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] PATH_INFO: `/v3/users/95ca39be6089441b8c7909bf8050736f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:33.543021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ca39be6089441b8c7909bf8050736f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:33.545761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:33.605522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:33.607852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:33.675919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ca39be6089441b8c7909bf8050736f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.694843 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ca39be6089441b8c7909bf8050736f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.705301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ca39be6089441b8c7909bf8050736f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.706516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ca39be6089441b8c7909bf8050736f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.745142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ca39be6089441b8c7909bf8050736f'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.767864 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c06663-00d0-4bc2-bb4c-1c0b0d136e28 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:33.776637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:33.779867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:33.780389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:33.780612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1166/2310] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:33 2022] DELETE /identity/v3/users/95ca39be6089441b8c7909bf8050736f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:33.782385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] PATH_INFO: `/v3/projects/b0b4eaefba9040b7a54e3a6917e4bfe1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:33.786127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b4eaefba9040b7a54e3a6917e4bfe1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:33.789920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:33.920045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b4eaefba9040b7a54e3a6917e4bfe1', 'request_id': 'req-f472cd95-5fa7-4d80-bf19-8ba1731a316c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.942830 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b4eaefba9040b7a54e3a6917e4bfe1', 'request_id': 'req-f472cd95-5fa7-4d80-bf19-8ba1731a316c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.961182 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b4eaefba9040b7a54e3a6917e4bfe1', 'request_id': 'req-f472cd95-5fa7-4d80-bf19-8ba1731a316c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.972413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:33.985136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] The token cache is being invalidate because project b0b4eaefba9040b7a54e3a6917e4bfe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:33.985804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.986734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:33.989237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1145/2311] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:33 2022] DELETE /identity/v3/projects/b0b4eaefba9040b7a54e3a6917e4bfe1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:09:33.996836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:33.998317 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:34.182806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0b32a-f2e3-41bc-a4c1-bfd637ea237c admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:34.300175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:34.332148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:34.333211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:34.333751 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:34.333928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] PATH_INFO: `/v3/users/afe657c1b0954523a4720ff3170cdce9` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:34.335262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe657c1b0954523a4720ff3170cdce9)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:34.344437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:34.408461 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:34.409890 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:34.452025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472cd95-5fa7-4d80-bf19-8ba1731a316c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:34.475327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:34.476227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:34.476578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:34.476862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] PATH_INFO: `/v3/projects/bcca67b28e2d4a0e8a1175bf01ad554d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:34.495507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcca67b28e2d4a0e8a1175bf01ad554d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:34.497522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:34.539529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe657c1b0954523a4720ff3170cdce9'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:34.548633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe657c1b0954523a4720ff3170cdce9'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:34.550596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe657c1b0954523a4720ff3170cdce9'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:34.556846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe657c1b0954523a4720ff3170cdce9'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:34.596255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe657c1b0954523a4720ff3170cdce9'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:34.634062 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1167/2312] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:33 2022] DELETE /identity/v3/users/afe657c1b0954523a4720ff3170cdce9 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:34.676619 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcca67b28e2d4a0e8a1175bf01ad554d', 'request_id': 'req-9a20ea86-2774-4a35-ba5d-c9a72a174276'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:34.686998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcca67b28e2d4a0e8a1175bf01ad554d', 'request_id': 'req-9a20ea86-2774-4a35-ba5d-c9a72a174276'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:34.731982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcca67b28e2d4a0e8a1175bf01ad554d', 'request_id': 'req-9a20ea86-2774-4a35-ba5d-c9a72a174276'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:34.808773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] The token cache is being invalidate because project bcca67b28e2d4a0e8a1175bf01ad554d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:34.814083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:34.821415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:34.840117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1146/2313] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:34 2022] DELETE /identity/v3/projects/bcca67b28e2d4a0e8a1175bf01ad554d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:34.841485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:34.846138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:35.102316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32b804-0829-473a-91b1-635cb52745b0 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:35.134024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:35.136337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:35.201635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c72e6-8768-4802-8add-46e672ee48ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:35.202720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c72e6-8768-4802-8add-46e672ee48ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:35.203211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c72e6-8768-4802-8add-46e672ee48ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:35.203494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c72e6-8768-4802-8add-46e672ee48ad admin admin] PATH_INFO: `/v3/users/af0885fbf7b64116884200aade01ab9e` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:35.205537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c72e6-8768-4802-8add-46e672ee48ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=af0885fbf7b64116884200aade01ab9e)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:35.207331 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c72e6-8768-4802-8add-46e672ee48ad admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:35.249208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:35.336902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-924c72e6-8768-4802-8add-46e672ee48ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af0885fbf7b64116884200aade01ab9e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:35.355604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-924c72e6-8768-4802-8add-46e672ee48ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af0885fbf7b64116884200aade01ab9e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:35.356696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-924c72e6-8768-4802-8add-46e672ee48ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af0885fbf7b64116884200aade01ab9e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:35.357773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-924c72e6-8768-4802-8add-46e672ee48ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af0885fbf7b64116884200aade01ab9e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:35.398335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-924c72e6-8768-4802-8add-46e672ee48ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af0885fbf7b64116884200aade01ab9e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:35.398556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20ea86-2774-4a35-ba5d-c9a72a174276 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:35.399159 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:35.400119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:35.400534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:35.400907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] PATH_INFO: `/v3/projects/4ebdddd165234b368ab5f197b6968e14` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:35.402431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ebdddd165234b368ab5f197b6968e14)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:35.406602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:35.421839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1168/2314] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:34 2022] DELETE /identity/v3/users/af0885fbf7b64116884200aade01ab9e => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:09:35.556432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ebdddd165234b368ab5f197b6968e14', 'request_id': 'req-868420ec-c7cf-495c-9410-15aabb80cce7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:35.565650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ebdddd165234b368ab5f197b6968e14', 'request_id': 'req-868420ec-c7cf-495c-9410-15aabb80cce7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:35.587109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ebdddd165234b368ab5f197b6968e14', 'request_id': 'req-868420ec-c7cf-495c-9410-15aabb80cce7'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:35.601971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] The token cache is being invalidate because project 4ebdddd165234b368ab5f197b6968e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:35.602389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:35.603826 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-868420ec-c7cf-495c-9410-15aabb80cce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:35.607937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1147/2315] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:35 2022] DELETE /identity/v3/projects/4ebdddd165234b368ab5f197b6968e14 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:35.614235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1347f-f690-4ca2-be7d-ac1dedb50e14 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:35.615534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1347f-f690-4ca2-be7d-ac1dedb50e14 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:35.618430 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1347f-f690-4ca2-be7d-ac1dedb50e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:35.651351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-89b1347f-f690-4ca2-be7d-ac1dedb50e14 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:35.653225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-89b1347f-f690-4ca2-be7d-ac1dedb50e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:35.777568 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1169/2316] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:35.779477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ede6de-3323-4fb3-aed1-e6fd32541f58 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:35.779773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ede6de-3323-4fb3-aed1-e6fd32541f58 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:35.780057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ede6de-3323-4fb3-aed1-e6fd32541f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:35.816446 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a1ede6de-3323-4fb3-aed1-e6fd32541f58 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:35.817700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a1ede6de-3323-4fb3-aed1-e6fd32541f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:35.837026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1148/2317] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:35.841011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1347f-f690-4ca2-be7d-ac1dedb50e14 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:35.851082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1347f-f690-4ca2-be7d-ac1dedb50e14 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:35.871947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e492c-63b2-4116-9e75-49cf9a01c542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:35.872834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e492c-63b2-4116-9e75-49cf9a01c542 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:35.873157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e492c-63b2-4116-9e75-49cf9a01c542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:35.873508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e492c-63b2-4116-9e75-49cf9a01c542 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:35.874329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e492c-63b2-4116-9e75-49cf9a01c542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:09:35.874647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e492c-63b2-4116-9e75-49cf9a01c542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:35.876343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e492c-63b2-4116-9e75-49cf9a01c542 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:35.907494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1170/2318] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:35.908953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ede6de-3323-4fb3-aed1-e6fd32541f58 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:35.916287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:35.921964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ede6de-3323-4fb3-aed1-e6fd32541f58 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:35.942564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd7c7b-e5ce-4667-880c-34d4181427b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:35.943344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd7c7b-e5ce-4667-880c-34d4181427b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:35.943659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd7c7b-e5ce-4667-880c-34d4181427b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:35.943934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd7c7b-e5ce-4667-880c-34d4181427b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:35.945339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd7c7b-e5ce-4667-880c-34d4181427b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:35.947368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd7c7b-e5ce-4667-880c-34d4181427b3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:36.008769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1149/2319] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:35 2022] POST /identity/v3/projects => generated 359 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:36.014293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e492c-63b2-4116-9e75-49cf9a01c542 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:36.050374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e492c-63b2-4116-9e75-49cf9a01c542 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:36.073901 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd7c7b-e5ce-4667-880c-34d4181427b3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:36.079708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f4bd7c7b-e5ce-4667-880c-34d4181427b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:36.213126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863639cc-2c04-436f-a0bb-9330014610a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:36.216503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863639cc-2c04-436f-a0bb-9330014610a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:36.216503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863639cc-2c04-436f-a0bb-9330014610a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:36.216503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863639cc-2c04-436f-a0bb-9330014610a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:36.216967 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863639cc-2c04-436f-a0bb-9330014610a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:36.220266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863639cc-2c04-436f-a0bb-9330014610a3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:36.322405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1171/2320] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:36 2022] POST /identity/v3/users => generated 280 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:36.322405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863639cc-2c04-436f-a0bb-9330014610a3 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:36.322405 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863639cc-2c04-436f-a0bb-9330014610a3 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:36.336746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653d970-d2a8-45d3-8b27-3d86fbf8f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:36.336746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d970-d2a8-45d3-8b27-3d86fbf8f831 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:36.336746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d970-d2a8-45d3-8b27-3d86fbf8f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:36.336746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d970-d2a8-45d3-8b27-3d86fbf8f831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:36.337135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653d970-d2a8-45d3-8b27-3d86fbf8f831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:36.337135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653d970-d2a8-45d3-8b27-3d86fbf8f831 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:36.362382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1172/2321] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:09:36.373710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653d970-d2a8-45d3-8b27-3d86fbf8f831 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:36.389980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:36.389980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653d970-d2a8-45d3-8b27-3d86fbf8f831 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:36.428663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea12cf-db93-43f4-b256-744c282f56db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:36.428663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea12cf-db93-43f4-b256-744c282f56db admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:36.428663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea12cf-db93-43f4-b256-744c282f56db admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:36.428663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea12cf-db93-43f4-b256-744c282f56db admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:36.429241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea12cf-db93-43f4-b256-744c282f56db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:36.434008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea12cf-db93-43f4-b256-744c282f56db admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:36.454681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd7c7b-e5ce-4667-880c-34d4181427b3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:36.461630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1173/2322] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:36.468474 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:36.469948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:36.470309 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:36.470594 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] PATH_INFO: `/v3/projects/2cc879adf0b041c198bb4fc9fe94312d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:36.472193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea12cf-db93-43f4-b256-744c282f56db admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:36.473521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc879adf0b041c198bb4fc9fe94312d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:36.492753 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:36.511559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea12cf-db93-43f4-b256-744c282f56db admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:36.538886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db9804-ce96-4635-a924-e164a7cccb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:36.546054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db9804-ce96-4635-a924-e164a7cccb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:36.546411 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db9804-ce96-4635-a924-e164a7cccb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:36.547386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db9804-ce96-4635-a924-e164a7cccb6a admin admin] PATH_INFO: `/v3/projects/771754d56dfa4e5d8875f059bc72ca42/users/ef35a3465f3b4c2cb42d657ba3fc260f/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:36.587056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db9804-ce96-4635-a924-e164a7cccb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=771754d56dfa4e5d8875f059bc72ca42, user_id=ef35a3465f3b4c2cb42d657ba3fc260f, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:36.590382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db9804-ce96-4635-a924-e164a7cccb6a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:36.607077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1174/2323] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:36 2022] PUT /identity/v3/projects/771754d56dfa4e5d8875f059bc72ca42/users/ef35a3465f3b4c2cb42d657ba3fc260f/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:36.617008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c565-cc96-4f74-90fe-0573c735c816 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:36.617301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c565-cc96-4f74-90fe-0573c735c816 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:36.617595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078c565-cc96-4f74-90fe-0573c735c816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:36.630091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc879adf0b041c198bb4fc9fe94312d', 'request_id': 'req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:36.653164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc879adf0b041c198bb4fc9fe94312d', 'request_id': 'req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:36.658942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4078c565-cc96-4f74-90fe-0573c735c816 None None] MFA Rules not processed for user `ef35a3465f3b4c2cb42d657ba3fc260f`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:36.660185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4078c565-cc96-4f74-90fe-0573c735c816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:36.678508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc879adf0b041c198bb4fc9fe94312d', 'request_id': 'req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:36.691414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] The token cache is being invalidate because project 2cc879adf0b041c198bb4fc9fe94312d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:36.691710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:36.692582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d6f2af0f-44e4-45cd-a7d5-7a7fad3e3911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:36.699256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1150/2324] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:36 2022] DELETE /identity/v3/projects/2cc879adf0b041c198bb4fc9fe94312d => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:36.701177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643eefb-e1e5-4294-85f0-0b8e151e6260 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:36.701600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643eefb-e1e5-4294-85f0-0b8e151e6260 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:36.701951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643eefb-e1e5-4294-85f0-0b8e151e6260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:36.756305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3643eefb-e1e5-4294-85f0-0b8e151e6260 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:36.759783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3643eefb-e1e5-4294-85f0-0b8e151e6260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:36.779257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1175/2325] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:36 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:09:36.813791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078c565-cc96-4f74-90fe-0573c735c816 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:36.815695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4078c565-cc96-4f74-90fe-0573c735c816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:36.855134 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1151/2326] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:09:36.865491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13d5dc-c2c2-4312-8474-fa6ad50f6b5a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:36.865687 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13d5dc-c2c2-4312-8474-fa6ad50f6b5a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:36.865971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13d5dc-c2c2-4312-8474-fa6ad50f6b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:36.899499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-8a13d5dc-c2c2-4312-8474-fa6ad50f6b5a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:36.901441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8a13d5dc-c2c2-4312-8474-fa6ad50f6b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:36.919101 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078c565-cc96-4f74-90fe-0573c735c816 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:36.924751 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230639b-1db8-4f31-9536-4a2d801e5ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:36.926569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230639b-1db8-4f31-9536-4a2d801e5ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:36.926984 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230639b-1db8-4f31-9536-4a2d801e5ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:36.927368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230639b-1db8-4f31-9536-4a2d801e5ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:36.949648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230639b-1db8-4f31-9536-4a2d801e5ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:36.951457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230639b-1db8-4f31-9536-4a2d801e5ba9 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:36.970921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1176/2327] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:36 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:36.976242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1152/2328] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:36.982491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230639b-1db8-4f31-9536-4a2d801e5ba9 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:36.992278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13d5dc-c2c2-4312-8474-fa6ad50f6b5a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:36.996150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-8a13d5dc-c2c2-4312-8474-fa6ad50f6b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:37.014586 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230639b-1db8-4f31-9536-4a2d801e5ba9 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:37.022781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13d5dc-c2c2-4312-8474-fa6ad50f6b5a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:37.030143 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced64c6-cd9d-43c9-b38b-15fbd56d3010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:37.031145 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced64c6-cd9d-43c9-b38b-15fbd56d3010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:37.031343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec68a3-23b3-4597-80cc-8ecb6e832599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:37.031569 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced64c6-cd9d-43c9-b38b-15fbd56d3010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:37.031907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced64c6-cd9d-43c9-b38b-15fbd56d3010 admin admin] PATH_INFO: `/v3/users/ef35a3465f3b4c2cb42d657ba3fc260f` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:37.032668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec68a3-23b3-4597-80cc-8ecb6e832599 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:37.033126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec68a3-23b3-4597-80cc-8ecb6e832599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:37.033336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced64c6-cd9d-43c9-b38b-15fbd56d3010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef35a3465f3b4c2cb42d657ba3fc260f)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:37.033826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec68a3-23b3-4597-80cc-8ecb6e832599 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:37.034735 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec68a3-23b3-4597-80cc-8ecb6e832599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:09:37.035291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec68a3-23b3-4597-80cc-8ecb6e832599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:37.035603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced64c6-cd9d-43c9-b38b-15fbd56d3010 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:37.037755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:37.037933 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec68a3-23b3-4597-80cc-8ecb6e832599 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:37.058390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1177/2329] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:37.075991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec68a3-23b3-4597-80cc-8ecb6e832599 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:37.124371 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec68a3-23b3-4597-80cc-8ecb6e832599 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:37.137972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4101d7d-857a-4209-8927-a158060bf10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:37.141079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4101d7d-857a-4209-8927-a158060bf10a admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:37.141616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4101d7d-857a-4209-8927-a158060bf10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:37.145226 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4101d7d-857a-4209-8927-a158060bf10a admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:37.146259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4101d7d-857a-4209-8927-a158060bf10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:37.150337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4101d7d-857a-4209-8927-a158060bf10a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:37.226760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1178/2330] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:37 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:37.237626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4ced64c6-cd9d-43c9-b38b-15fbd56d3010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef35a3465f3b4c2cb42d657ba3fc260f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:37.237626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4ced64c6-cd9d-43c9-b38b-15fbd56d3010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef35a3465f3b4c2cb42d657ba3fc260f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:37.254941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4101d7d-857a-4209-8927-a158060bf10a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:37.277494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4ced64c6-cd9d-43c9-b38b-15fbd56d3010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef35a3465f3b4c2cb42d657ba3fc260f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:37.309009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:37.321363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4ced64c6-cd9d-43c9-b38b-15fbd56d3010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef35a3465f3b4c2cb42d657ba3fc260f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:37.325004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4ced64c6-cd9d-43c9-b38b-15fbd56d3010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef35a3465f3b4c2cb42d657ba3fc260f'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:37.374849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1153/2331] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:36 2022] DELETE /identity/v3/users/ef35a3465f3b4c2cb42d657ba3fc260f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:37.379603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09930-20ed-42bc-8f58-dc3903ebbd77 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:37.380057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09930-20ed-42bc-8f58-dc3903ebbd77 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:37.380552 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09930-20ed-42bc-8f58-dc3903ebbd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:37.382151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4101d7d-857a-4209-8927-a158060bf10a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:37.422001 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a1f09930-20ed-42bc-8f58-dc3903ebbd77 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:37.424034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a1f09930-20ed-42bc-8f58-dc3903ebbd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:37.522273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5e23-edbe-4399-9819-567aa02bc454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:37.523128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5e23-edbe-4399-9819-567aa02bc454 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:37.523515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5e23-edbe-4399-9819-567aa02bc454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:37.524202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5e23-edbe-4399-9819-567aa02bc454 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:37.525369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5e23-edbe-4399-9819-567aa02bc454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:37.530117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5e23-edbe-4399-9819-567aa02bc454 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:37.581180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1179/2332] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:37 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:09:37.585065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5e23-edbe-4399-9819-567aa02bc454 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:37.598999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-614e5e23-edbe-4399-9819-567aa02bc454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:37.626738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5e23-edbe-4399-9819-567aa02bc454 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:37.630404 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1154/2333] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:37.640284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f09930-20ed-42bc-8f58-dc3903ebbd77 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:37.642110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a1f09930-20ed-42bc-8f58-dc3903ebbd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:37.649081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23908709-fa21-4fa0-8aaf-31353b9ca4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:37.649816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908709-fa21-4fa0-8aaf-31353b9ca4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:37.650092 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908709-fa21-4fa0-8aaf-31353b9ca4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:37.650398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23908709-fa21-4fa0-8aaf-31353b9ca4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:37.651215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23908709-fa21-4fa0-8aaf-31353b9ca4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:37.653313 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23908709-fa21-4fa0-8aaf-31353b9ca4dd admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:37.687532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1180/2334] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:37.692432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23908709-fa21-4fa0-8aaf-31353b9ca4dd admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:37.720537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23908709-fa21-4fa0-8aaf-31353b9ca4dd admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:37.732376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e22f2-a039-4540-af56-5863f4d0264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:37.733074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e22f2-a039-4540-af56-5863f4d0264e admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:37.733366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e22f2-a039-4540-af56-5863f4d0264e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:37.733653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e22f2-a039-4540-af56-5863f4d0264e admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:37.735374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e22f2-a039-4540-af56-5863f4d0264e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:37.736039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e22f2-a039-4540-af56-5863f4d0264e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:37.808616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1181/2335] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:37.810240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f09930-20ed-42bc-8f58-dc3903ebbd77 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:37.812694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e22f2-a039-4540-af56-5863f4d0264e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:37.815085 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a91232-914f-4a66-8b88-4a54ca94bee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:37.816159 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a91232-914f-4a66-8b88-4a54ca94bee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:37.817199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a91232-914f-4a66-8b88-4a54ca94bee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:37.818589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a91232-914f-4a66-8b88-4a54ca94bee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:37.841761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a91232-914f-4a66-8b88-4a54ca94bee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:37.843029 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e22f2-a039-4540-af56-5863f4d0264e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:37.845008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a91232-914f-4a66-8b88-4a54ca94bee2 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:37.868844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814071b-1341-40b4-9c97-4dd839969ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:37.869774 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814071b-1341-40b4-9c97-4dd839969ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:37.870066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814071b-1341-40b4-9c97-4dd839969ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:37.870349 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814071b-1341-40b4-9c97-4dd839969ea3 admin admin] PATH_INFO: `/v3/projects/0a2a6c7393c4441c8bc15aaacccfedeb/users/2ca9b0b3c4d2492d93b17cd5847a4e52/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:37.872771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1155/2336] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:09:37.915921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814071b-1341-40b4-9c97-4dd839969ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2a6c7393c4441c8bc15aaacccfedeb, user_id=2ca9b0b3c4d2492d93b17cd5847a4e52, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:37.918707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814071b-1341-40b4-9c97-4dd839969ea3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:37.956289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1182/2337] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:37 2022] PUT /identity/v3/projects/0a2a6c7393c4441c8bc15aaacccfedeb/users/2ca9b0b3c4d2492d93b17cd5847a4e52/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:37.968911 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01ff9-380b-432d-a4f8-ee4cf561664f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:37.969223 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01ff9-380b-432d-a4f8-ee4cf561664f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:37.969472 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01ff9-380b-432d-a4f8-ee4cf561664f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:38.047621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5fb01ff9-380b-432d-a4f8-ee4cf561664f None None] MFA Rules not processed for user `2ca9b0b3c4d2492d93b17cd5847a4e52`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:38.051488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5fb01ff9-380b-432d-a4f8-ee4cf561664f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:38.081725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:38.192243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1156/2338] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:38.207027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814071b-1341-40b4-9c97-4dd839969ea3 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:38.212904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e814071b-1341-40b4-9c97-4dd839969ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:38.328198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814071b-1341-40b4-9c97-4dd839969ea3 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:38.334183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83938c-e964-4c55-9887-fc1b033ede2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:38.334889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83938c-e964-4c55-9887-fc1b033ede2b service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:38.335231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83938c-e964-4c55-9887-fc1b033ede2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:38.336063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83938c-e964-4c55-9887-fc1b033ede2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:38.352052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83938c-e964-4c55-9887-fc1b033ede2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:38.354200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83938c-e964-4c55-9887-fc1b033ede2b service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:38.377946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1183/2339] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:38.403443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01ff9-380b-432d-a4f8-ee4cf561664f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:38.405057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5fb01ff9-380b-432d-a4f8-ee4cf561664f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:38.486134 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01ff9-380b-432d-a4f8-ee4cf561664f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:38.493580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:38.493580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:38.494056 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:38.494502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] PATH_INFO: `/v3/projects/771754d56dfa4e5d8875f059bc72ca42` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:38.496798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=771754d56dfa4e5d8875f059bc72ca42)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:38.501465 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:38.577972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771754d56dfa4e5d8875f059bc72ca42', 'request_id': 'req-5b479e7e-b30e-45b8-9978-5e3612b81d4c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:38.595309 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771754d56dfa4e5d8875f059bc72ca42', 'request_id': 'req-5b479e7e-b30e-45b8-9978-5e3612b81d4c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:38.609982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771754d56dfa4e5d8875f059bc72ca42', 'request_id': 'req-5b479e7e-b30e-45b8-9978-5e3612b81d4c'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:38.627840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] The token cache is being invalidate because project 771754d56dfa4e5d8875f059bc72ca42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:38.628452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:38.629218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-5b479e7e-b30e-45b8-9978-5e3612b81d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:38.636557 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324775a-d246-4c03-8d56-22e53ad0fb8b None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:38.637231 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324775a-d246-4c03-8d56-22e53ad0fb8b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:38.638351 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324775a-d246-4c03-8d56-22e53ad0fb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:38.646868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1157/2340] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:38 2022] DELETE /identity/v3/projects/771754d56dfa4e5d8875f059bc72ca42 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:38.702903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c324775a-d246-4c03-8d56-22e53ad0fb8b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:38.706545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c324775a-d246-4c03-8d56-22e53ad0fb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:38.729481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:38.899469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1184/2341] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:09:38.908123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb98dd-26b7-4b98-8a6c-365b5260e3bf None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:38.908449 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb98dd-26b7-4b98-8a6c-365b5260e3bf None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:38.908738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb98dd-26b7-4b98-8a6c-365b5260e3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:38.952998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-74bb98dd-26b7-4b98-8a6c-365b5260e3bf None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:38.960364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-74bb98dd-26b7-4b98-8a6c-365b5260e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:38.999491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1158/2342] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:39.000363 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324775a-d246-4c03-8d56-22e53ad0fb8b None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:39.036915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324775a-d246-4c03-8d56-22e53ad0fb8b None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:39.076170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ebc2b-227d-4b1d-a6d2-41aecee18932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:39.078985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ebc2b-227d-4b1d-a6d2-41aecee18932 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:39.079290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ebc2b-227d-4b1d-a6d2-41aecee18932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:39.079577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ebc2b-227d-4b1d-a6d2-41aecee18932 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:39.089958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ebc2b-227d-4b1d-a6d2-41aecee18932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:09:39.090440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ebc2b-227d-4b1d-a6d2-41aecee18932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:39.096973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ebc2b-227d-4b1d-a6d2-41aecee18932 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:39.117676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1185/2343] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:09:39.119166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb98dd-26b7-4b98-8a6c-365b5260e3bf None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:39.160989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb98dd-26b7-4b98-8a6c-365b5260e3bf None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:39.171600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede8a69-ee29-479e-8534-f75b55b484fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:39.172573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede8a69-ee29-479e-8534-f75b55b484fa admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:39.173042 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede8a69-ee29-479e-8534-f75b55b484fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:39.173599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede8a69-ee29-479e-8534-f75b55b484fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:39.174769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede8a69-ee29-479e-8534-f75b55b484fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:39.177739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede8a69-ee29-479e-8534-f75b55b484fa admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:39.234273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1159/2344] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:39 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:39.236959 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ebc2b-227d-4b1d-a6d2-41aecee18932 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:39.273617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ebc2b-227d-4b1d-a6d2-41aecee18932 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:39.398964 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ebb6f-5e07-4978-ba0c-db29820e45f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:39.400948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ebb6f-5e07-4978-ba0c-db29820e45f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:39.401432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ebb6f-5e07-4978-ba0c-db29820e45f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:39.401936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ebb6f-5e07-4978-ba0c-db29820e45f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:39.402841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ebb6f-5e07-4978-ba0c-db29820e45f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:39.405104 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ebb6f-5e07-4978-ba0c-db29820e45f1 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:39.442780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1186/2345] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:39 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:39.447436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede8a69-ee29-479e-8534-f75b55b484fa admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:39.468789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede8a69-ee29-479e-8534-f75b55b484fa admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:39.474640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b745f25-9788-4102-bba7-7f3ddcd416c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:39.475082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b745f25-9788-4102-bba7-7f3ddcd416c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:39.475589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b745f25-9788-4102-bba7-7f3ddcd416c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:39.476136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b745f25-9788-4102-bba7-7f3ddcd416c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:39.477063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b745f25-9788-4102-bba7-7f3ddcd416c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:39.478955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b745f25-9788-4102-bba7-7f3ddcd416c0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:39.493375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1160/2346] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:39.496459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ebb6f-5e07-4978-ba0c-db29820e45f1 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:39.519592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ebb6f-5e07-4978-ba0c-db29820e45f1 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:39.527826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96316219-0c95-4368-aa1b-31d2f825d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:39.528700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96316219-0c95-4368-aa1b-31d2f825d3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:39.529057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96316219-0c95-4368-aa1b-31d2f825d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:39.529413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96316219-0c95-4368-aa1b-31d2f825d3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:39.530451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96316219-0c95-4368-aa1b-31d2f825d3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:39.532365 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96316219-0c95-4368-aa1b-31d2f825d3f4 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:39.549062 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1187/2347] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:39.553092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b745f25-9788-4102-bba7-7f3ddcd416c0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:39.560232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:39.573028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b745f25-9788-4102-bba7-7f3ddcd416c0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:39.589742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062835b-e7f7-47f2-8eb3-41efec73dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:39.590653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062835b-e7f7-47f2-8eb3-41efec73dc78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:39.590943 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062835b-e7f7-47f2-8eb3-41efec73dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:39.591232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062835b-e7f7-47f2-8eb3-41efec73dc78 admin admin] PATH_INFO: `/v3/projects/73da82cb9b4f4366afc66b2cba1a0572/users/6e81a3f557ea40b4937b1fa1278b8e85/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:39.623555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062835b-e7f7-47f2-8eb3-41efec73dc78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73da82cb9b4f4366afc66b2cba1a0572, user_id=6e81a3f557ea40b4937b1fa1278b8e85, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:39.627083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062835b-e7f7-47f2-8eb3-41efec73dc78 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:39.664433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1161/2348] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:39 2022] PUT /identity/v3/projects/73da82cb9b4f4366afc66b2cba1a0572/users/6e81a3f557ea40b4937b1fa1278b8e85/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:39.673319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707e38-5b19-4642-bacc-a8eca3231b8f None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:39.673617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707e38-5b19-4642-bacc-a8eca3231b8f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:39.673904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8707e38-5b19-4642-bacc-a8eca3231b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:39.714883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a8707e38-5b19-4642-bacc-a8eca3231b8f None None] MFA Rules not processed for user `6e81a3f557ea40b4937b1fa1278b8e85`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:39.716049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a8707e38-5b19-4642-bacc-a8eca3231b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:39.876416 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1188/2349] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:39.879445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062835b-e7f7-47f2-8eb3-41efec73dc78 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:40.003149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062835b-e7f7-47f2-8eb3-41efec73dc78 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:40.009568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dc03f-1f67-4fd3-ab49-9cf30bc07f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:40.010542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc03f-1f67-4fd3-ab49-9cf30bc07f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:40.010834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc03f-1f67-4fd3-ab49-9cf30bc07f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:40.011113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dc03f-1f67-4fd3-ab49-9cf30bc07f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:40.011969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dc03f-1f67-4fd3-ab49-9cf30bc07f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:40.013990 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dc03f-1f67-4fd3-ab49-9cf30bc07f92 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:40.112954 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1162/2350] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:39 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:40.114492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8707e38-5b19-4642-bacc-a8eca3231b8f None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:40.133882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8707e38-5b19-4642-bacc-a8eca3231b8f None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:40.203446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:40.377560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9700e76-9e5e-4f51-855e-5f3a0e483a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:40.378517 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9700e76-9e5e-4f51-855e-5f3a0e483a10 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:40.379019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9700e76-9e5e-4f51-855e-5f3a0e483a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:40.380341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9700e76-9e5e-4f51-855e-5f3a0e483a10 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:40.381522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9700e76-9e5e-4f51-855e-5f3a0e483a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:40.385227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9700e76-9e5e-4f51-855e-5f3a0e483a10 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:40.426716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1189/2351] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:40 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:40.427894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dc03f-1f67-4fd3-ab49-9cf30bc07f92 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:40.445638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dc03f-1f67-4fd3-ab49-9cf30bc07f92 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:40.452279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad713d96-b08d-43ef-9ab0-aa7cec031ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:40.453310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad713d96-b08d-43ef-9ab0-aa7cec031ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:40.453764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad713d96-b08d-43ef-9ab0-aa7cec031ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:40.454546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad713d96-b08d-43ef-9ab0-aa7cec031ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:40.456031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad713d96-b08d-43ef-9ab0-aa7cec031ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:40.459120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad713d96-b08d-43ef-9ab0-aa7cec031ecf admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:40.475627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1163/2352] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:40.482121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9700e76-9e5e-4f51-855e-5f3a0e483a10 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:40.498850 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9700e76-9e5e-4f51-855e-5f3a0e483a10 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:40.507969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b628bb-2faa-459d-ab36-0556196d93c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:40.508732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b628bb-2faa-459d-ab36-0556196d93c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:40.509815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b628bb-2faa-459d-ab36-0556196d93c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:40.510192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b628bb-2faa-459d-ab36-0556196d93c4 admin admin] PATH_INFO: `/v3/projects/52843ff0e26d4abba2051674ed9fed9b/users/d433f000d0734270889aaa209ef18f5a/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:40.536952 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b628bb-2faa-459d-ab36-0556196d93c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52843ff0e26d4abba2051674ed9fed9b, user_id=d433f000d0734270889aaa209ef18f5a, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:40.544349 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b628bb-2faa-459d-ab36-0556196d93c4 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:40.584441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1190/2353] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:40 2022] PUT /identity/v3/projects/52843ff0e26d4abba2051674ed9fed9b/users/d433f000d0734270889aaa209ef18f5a/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:40.587712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad713d96-b08d-43ef-9ab0-aa7cec031ecf admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:40.616450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad713d96-b08d-43ef-9ab0-aa7cec031ecf admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:40.866996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ce5a6-61b3-45ba-919b-1a812f0bb47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:40.869586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ce5a6-61b3-45ba-919b-1a812f0bb47f admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:40.870109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ce5a6-61b3-45ba-919b-1a812f0bb47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:40.870578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ce5a6-61b3-45ba-919b-1a812f0bb47f admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:40.872043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ce5a6-61b3-45ba-919b-1a812f0bb47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:40.874250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ce5a6-61b3-45ba-919b-1a812f0bb47f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:40.921123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b628bb-2faa-459d-ab36-0556196d93c4 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:40.933519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1164/2354] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:40.948438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b628bb-2faa-459d-ab36-0556196d93c4 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:40.980620 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442282ce-7009-466a-a93a-dc3abb494fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:40.982581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442282ce-7009-466a-a93a-dc3abb494fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:40.982978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442282ce-7009-466a-a93a-dc3abb494fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:40.983362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442282ce-7009-466a-a93a-dc3abb494fd5 admin admin] PATH_INFO: `/v3/projects/52843ff0e26d4abba2051674ed9fed9b/users/d433f000d0734270889aaa209ef18f5a/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:40.987781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442282ce-7009-466a-a93a-dc3abb494fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52843ff0e26d4abba2051674ed9fed9b, user_id=d433f000d0734270889aaa209ef18f5a, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:40.993360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442282ce-7009-466a-a93a-dc3abb494fd5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:41.013168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1191/2355] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:40 2022] PUT /identity/v3/projects/52843ff0e26d4abba2051674ed9fed9b/users/d433f000d0734270889aaa209ef18f5a/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:09:41.029206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bbcf6-75d1-4b99-aa02-9572a42ab83d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:41.029584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bbcf6-75d1-4b99-aa02-9572a42ab83d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:41.029873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bbcf6-75d1-4b99-aa02-9572a42ab83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:41.072249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-480bbcf6-75d1-4b99-aa02-9572a42ab83d None None] MFA Rules not processed for user `d433f000d0734270889aaa209ef18f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:41.075416 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-480bbcf6-75d1-4b99-aa02-9572a42ab83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:41.164088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:41.219828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1165/2356] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:41.254018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442282ce-7009-466a-a93a-dc3abb494fd5 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:41.259437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-442282ce-7009-466a-a93a-dc3abb494fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:41.468349 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442282ce-7009-466a-a93a-dc3abb494fd5 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:41.475595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910560f-ba6a-4d88-95a4-547015214623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:41.475595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910560f-ba6a-4d88-95a4-547015214623 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:41.475595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910560f-ba6a-4d88-95a4-547015214623 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:41.475595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910560f-ba6a-4d88-95a4-547015214623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:41.602675 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910560f-ba6a-4d88-95a4-547015214623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:41.604622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910560f-ba6a-4d88-95a4-547015214623 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:41.643651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1192/2357] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:42.120009 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8181dc-8254-4c7a-9f94-295529309bbb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:42.120624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8181dc-8254-4c7a-9f94-295529309bbb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:42.120725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8181dc-8254-4c7a-9f94-295529309bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:42.150614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5d8181dc-8254-4c7a-9f94-295529309bbb None None] MFA Rules not processed for user `57b64cdf97214cddb23851747cb051d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:42.151881 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5d8181dc-8254-4c7a-9f94-295529309bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:42.366361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1166/2358] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:44.649776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910560f-ba6a-4d88-95a4-547015214623 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:44.684468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:44.763462 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910560f-ba6a-4d88-95a4-547015214623 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:44.779080 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:44.780085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:44.782164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:44.782492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] PATH_INFO: `/v3/users/6e81a3f557ea40b4937b1fa1278b8e85` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:44.784672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e81a3f557ea40b4937b1fa1278b8e85)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:44.786915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:44.855428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e81a3f557ea40b4937b1fa1278b8e85'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:44.864982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e81a3f557ea40b4937b1fa1278b8e85'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:44.865934 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e81a3f557ea40b4937b1fa1278b8e85'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:44.866627 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e81a3f557ea40b4937b1fa1278b8e85'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:44.881657 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e81a3f557ea40b4937b1fa1278b8e85'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:44.901661 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1193/2359] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:44 2022] DELETE /identity/v3/users/6e81a3f557ea40b4937b1fa1278b8e85 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:44.906212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070b6d1-e3d3-4dc9-9436-86302210441c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:44.907074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070b6d1-e3d3-4dc9-9436-86302210441c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:44.907360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070b6d1-e3d3-4dc9-9436-86302210441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:44.928654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6070b6d1-e3d3-4dc9-9436-86302210441c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:44.930207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6070b6d1-e3d3-4dc9-9436-86302210441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:45.009628 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1167/2360] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:45.021703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:45.023844 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:45.096176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50b97f-75ea-4876-aba3-b6f2a4ec0a53 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:45.101436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c1919-a330-4930-bbe9-1e20639de9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:45.102202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1919-a330-4930-bbe9-1e20639de9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:45.102471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1919-a330-4930-bbe9-1e20639de9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:45.102748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1919-a330-4930-bbe9-1e20639de9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:45.117807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c1919-a330-4930-bbe9-1e20639de9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:45.119781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c1919-a330-4930-bbe9-1e20639de9a4 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:45.139164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1194/2361] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:45.201664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55ecec-8a1c-4b4d-a5bd-24aa7b6e0c7f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:45.202313 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55ecec-8a1c-4b4d-a5bd-24aa7b6e0c7f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:45.202822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55ecec-8a1c-4b4d-a5bd-24aa7b6e0c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:45.224540 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9c55ecec-8a1c-4b4d-a5bd-24aa7b6e0c7f None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:45.226157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9c55ecec-8a1c-4b4d-a5bd-24aa7b6e0c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:45.339898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1168/2362] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:09:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:45.368838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c1919-a330-4930-bbe9-1e20639de9a4 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:45.368838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6f4c1919-a330-4930-bbe9-1e20639de9a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:45.418261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55ecec-8a1c-4b4d-a5bd-24aa7b6e0c7f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:45.420754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9c55ecec-8a1c-4b4d-a5bd-24aa7b6e0c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:45.459962 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55ecec-8a1c-4b4d-a5bd-24aa7b6e0c7f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:45.480300 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ea131-32a2-4b8f-b39a-88baa9bcbfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:45.481817 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ea131-32a2-4b8f-b39a-88baa9bcbfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:45.482441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ea131-32a2-4b8f-b39a-88baa9bcbfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:45.482942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ea131-32a2-4b8f-b39a-88baa9bcbfeb admin admin] PATH_INFO: `/v3/users/2ca9b0b3c4d2492d93b17cd5847a4e52` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:45.485256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ea131-32a2-4b8f-b39a-88baa9bcbfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca9b0b3c4d2492d93b17cd5847a4e52)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:45.490679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ea131-32a2-4b8f-b39a-88baa9bcbfeb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:45.491588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:45.530839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:45.575411 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c1919-a330-4930-bbe9-1e20639de9a4 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:45.593321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f210d-8b2f-474a-ae11-dd0bad4aee85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:45.593800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f210d-8b2f-474a-ae11-dd0bad4aee85 service swift] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:45.594093 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f210d-8b2f-474a-ae11-dd0bad4aee85 service swift] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:45.594370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f210d-8b2f-474a-ae11-dd0bad4aee85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:45.611327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f210d-8b2f-474a-ae11-dd0bad4aee85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:45.612329 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2c0ea131-32a2-4b8f-b39a-88baa9bcbfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca9b0b3c4d2492d93b17cd5847a4e52'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:45.613537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2c0ea131-32a2-4b8f-b39a-88baa9bcbfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca9b0b3c4d2492d93b17cd5847a4e52'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:45.615537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f210d-8b2f-474a-ae11-dd0bad4aee85 service swift] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:45.626012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2c0ea131-32a2-4b8f-b39a-88baa9bcbfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca9b0b3c4d2492d93b17cd5847a4e52'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:45.644116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2c0ea131-32a2-4b8f-b39a-88baa9bcbfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca9b0b3c4d2492d93b17cd5847a4e52'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:45.645195 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1195/2363] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:09:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:09:45.646312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f210d-8b2f-474a-ae11-dd0bad4aee85 service swift] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:45.648351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2c0ea131-32a2-4b8f-b39a-88baa9bcbfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca9b0b3c4d2492d93b17cd5847a4e52'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:45.651486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-775f210d-8b2f-474a-ae11-dd0bad4aee85 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:45.680739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1169/2364] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:45 2022] DELETE /identity/v3/users/2ca9b0b3c4d2492d93b17cd5847a4e52 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:09:45.682655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ea7d9-408c-427f-8dc0-09e48b4f645a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:45.686972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ea7d9-408c-427f-8dc0-09e48b4f645a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:45.687271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ea7d9-408c-427f-8dc0-09e48b4f645a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:45.692478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f210d-8b2f-474a-ae11-dd0bad4aee85 service swift] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:45.737510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1b0ea7d9-408c-427f-8dc0-09e48b4f645a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:45.738951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1b0ea7d9-408c-427f-8dc0-09e48b4f645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:45.873234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:45.874235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:45.874582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:45.874930 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] PATH_INFO: `/v3/projects/73da82cb9b4f4366afc66b2cba1a0572` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:45.878287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73da82cb9b4f4366afc66b2cba1a0572)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:45.885632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:45.935068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1170/2365] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:45.950340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ea7d9-408c-427f-8dc0-09e48b4f645a None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:45.954320 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1b0ea7d9-408c-427f-8dc0-09e48b4f645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:46.003107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73da82cb9b4f4366afc66b2cba1a0572', 'request_id': 'req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:46.017982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73da82cb9b4f4366afc66b2cba1a0572', 'request_id': 'req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:46.026618 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73da82cb9b4f4366afc66b2cba1a0572', 'request_id': 'req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:46.084856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] The token cache is being invalidate because project 73da82cb9b4f4366afc66b2cba1a0572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:46.087097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:46.088935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:46.090789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1196/2366] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:45 2022] DELETE /identity/v3/projects/73da82cb9b4f4366afc66b2cba1a0572 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:46.099970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:46.107884 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:46.131605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ea7d9-408c-427f-8dc0-09e48b4f645a None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:46.370363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:46.443861 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:46.445620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f45754-ee02-4ba8-81db-5016d04098f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:46.446376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45754-ee02-4ba8-81db-5016d04098f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:46.446728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45754-ee02-4ba8-81db-5016d04098f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:46.447140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45754-ee02-4ba8-81db-5016d04098f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:46.449409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-16f45754-ee02-4ba8-81db-5016d04098f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:46.652966 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72322b-35e0-48c8-b7fd-7e33d2ad1aa7 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:46.662301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:46.664584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:46.664962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:46.665256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] PATH_INFO: `/v3/users/d433f000d0734270889aaa209ef18f5a` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:46.669977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d433f000d0734270889aaa209ef18f5a)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:46.674777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:46.677415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f45754-ee02-4ba8-81db-5016d04098f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:46.684017 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f45754-ee02-4ba8-81db-5016d04098f8 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:46.721387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1171/2367] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:46.869296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd433f000d0734270889aaa209ef18f5a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:46.885850 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd433f000d0734270889aaa209ef18f5a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:46.890305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd433f000d0734270889aaa209ef18f5a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:46.890946 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd433f000d0734270889aaa209ef18f5a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:46.915667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd433f000d0734270889aaa209ef18f5a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:46.944025 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1197/2368] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:46 2022] DELETE /identity/v3/users/d433f000d0734270889aaa209ef18f5a => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:47.762168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f45754-ee02-4ba8-81db-5016d04098f8 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:47.764731 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-16f45754-ee02-4ba8-81db-5016d04098f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:47.771175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:47.772958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:47.816966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f45754-ee02-4ba8-81db-5016d04098f8 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:47.957625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:47.959099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:47.959744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:47.960349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] PATH_INFO: `/v3/projects/0a2a6c7393c4441c8bc15aaacccfedeb` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:47.962667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2a6c7393c4441c8bc15aaacccfedeb)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:47.965125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:47.984105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ebcde-f6e3-4b98-8b91-a4399d1138aa admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:47.989085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:47.990096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:47.990380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:47.990655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] PATH_INFO: `/v3/projects/52843ff0e26d4abba2051674ed9fed9b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:47.993113 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52843ff0e26d4abba2051674ed9fed9b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:47.995058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:48.136012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:48.141983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2a6c7393c4441c8bc15aaacccfedeb', 'request_id': 'req-4a1b27cc-516c-419a-8dd1-8d1f434be602'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:48.161566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2a6c7393c4441c8bc15aaacccfedeb', 'request_id': 'req-4a1b27cc-516c-419a-8dd1-8d1f434be602'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:48.168303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52843ff0e26d4abba2051674ed9fed9b', 'request_id': 'req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:48.181490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52843ff0e26d4abba2051674ed9fed9b', 'request_id': 'req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:48.185847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2a6c7393c4441c8bc15aaacccfedeb', 'request_id': 'req-4a1b27cc-516c-419a-8dd1-8d1f434be602'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:48.191557 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:48.197858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52843ff0e26d4abba2051674ed9fed9b', 'request_id': 'req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:48.222355 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] The token cache is being invalidate because project 0a2a6c7393c4441c8bc15aaacccfedeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:48.222662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:48.223392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-4a1b27cc-516c-419a-8dd1-8d1f434be602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:48.224349 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] The token cache is being invalidate because project 52843ff0e26d4abba2051674ed9fed9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:48.225448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:48.227467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-eaac5c28-076e-4d4e-a3e7-e9329eaf78d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:48.228411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1172/2369] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:47 2022] DELETE /identity/v3/projects/0a2a6c7393c4441c8bc15aaacccfedeb => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:48.229825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1198/2370] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:47 2022] DELETE /identity/v3/projects/52843ff0e26d4abba2051674ed9fed9b => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:09:48.237251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52ee51-9ce7-4b60-88f4-94b87d0d83ab None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:48.237736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52ee51-9ce7-4b60-88f4-94b87d0d83ab None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:48.238198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52ee51-9ce7-4b60-88f4-94b87d0d83ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:48.239316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7115d-1d7c-49cb-bb1a-78a82e07aae5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:48.239688 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7115d-1d7c-49cb-bb1a-78a82e07aae5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:48.239968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7115d-1d7c-49cb-bb1a-78a82e07aae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:48.335576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-bb52ee51-9ce7-4b60-88f4-94b87d0d83ab None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:48.338486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-bb52ee51-9ce7-4b60-88f4-94b87d0d83ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:48.344505 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-84c7115d-1d7c-49cb-bb1a-78a82e07aae5 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:48.347736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-84c7115d-1d7c-49cb-bb1a-78a82e07aae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:48.478587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1199/2371] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:48.489922 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a665ac-07b8-47cb-b4c2-309a33b0ae5a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:48.490222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a665ac-07b8-47cb-b4c2-309a33b0ae5a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:48.490503 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a665ac-07b8-47cb-b4c2-309a33b0ae5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:48.537882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a7a665ac-07b8-47cb-b4c2-309a33b0ae5a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:48.541266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a7a665ac-07b8-47cb-b4c2-309a33b0ae5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:48.557286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1200/2372] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:48.580787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a665ac-07b8-47cb-b4c2-309a33b0ae5a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:48.596872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a665ac-07b8-47cb-b4c2-309a33b0ae5a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:48.612476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d288a89-4e5e-4aaa-8cf4-2e2d0876fbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:48.614955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1173/2373] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:48.615592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d288a89-4e5e-4aaa-8cf4-2e2d0876fbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:48.616247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d288a89-4e5e-4aaa-8cf4-2e2d0876fbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:48.617136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d288a89-4e5e-4aaa-8cf4-2e2d0876fbf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:48.617897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d288a89-4e5e-4aaa-8cf4-2e2d0876fbf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:09:48.618211 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d288a89-4e5e-4aaa-8cf4-2e2d0876fbf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:48.620093 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d288a89-4e5e-4aaa-8cf4-2e2d0876fbf3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:48.624677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1725f-824f-4383-b0bd-e5ec8138c546 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:48.624975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1725f-824f-4383-b0bd-e5ec8138c546 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:48.625254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1725f-824f-4383-b0bd-e5ec8138c546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:48.651508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1201/2374] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:48.655467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d288a89-4e5e-4aaa-8cf4-2e2d0876fbf3 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:48.665699 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-bce1725f-824f-4383-b0bd-e5ec8138c546 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:48.665699 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-bce1725f-824f-4383-b0bd-e5ec8138c546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:48.671823 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d288a89-4e5e-4aaa-8cf4-2e2d0876fbf3 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:48.676481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1174/2375] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:48.678245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b4e7c-7f91-4629-92b0-b94cc94512f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:48.679497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b4e7c-7f91-4629-92b0-b94cc94512f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:48.679784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b4e7c-7f91-4629-92b0-b94cc94512f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:48.680065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b4e7c-7f91-4629-92b0-b94cc94512f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:48.680547 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1725f-824f-4383-b0bd-e5ec8138c546 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:48.680847 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b4e7c-7f91-4629-92b0-b94cc94512f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:48.682761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b4e7c-7f91-4629-92b0-b94cc94512f6 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:48.701476 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1725f-824f-4383-b0bd-e5ec8138c546 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:48.709010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f72ff-d9a1-4ce0-8723-11756fc46504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:48.710462 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f72ff-d9a1-4ce0-8723-11756fc46504 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:48.710864 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f72ff-d9a1-4ce0-8723-11756fc46504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:48.711223 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f72ff-d9a1-4ce0-8723-11756fc46504 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:48.712079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f72ff-d9a1-4ce0-8723-11756fc46504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:09:48.712539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f72ff-d9a1-4ce0-8723-11756fc46504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:48.714244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f72ff-d9a1-4ce0-8723-11756fc46504 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:48.719862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1202/2376] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:48 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:09:48.724551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b4e7c-7f91-4629-92b0-b94cc94512f6 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:48.802666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:48.807702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b4e7c-7f91-4629-92b0-b94cc94512f6 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:48.813517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1175/2377] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:09:48.816210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d6d46-55f9-46fe-8b23-a591a0c86e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:48.817132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d6d46-55f9-46fe-8b23-a591a0c86e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:48.817748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d6d46-55f9-46fe-8b23-a591a0c86e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:48.818411 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d6d46-55f9-46fe-8b23-a591a0c86e26 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:48.819816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d6d46-55f9-46fe-8b23-a591a0c86e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:48.822280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d6d46-55f9-46fe-8b23-a591a0c86e26 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:48.822625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f72ff-d9a1-4ce0-8723-11756fc46504 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:48.854103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f72ff-d9a1-4ce0-8723-11756fc46504 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:48.874776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1203/2378] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:48 2022] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:48.878373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d6d46-55f9-46fe-8b23-a591a0c86e26 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:48.885777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7830d-e975-442c-a826-503646c74f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:48.887720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7830d-e975-442c-a826-503646c74f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:48.888369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7830d-e975-442c-a826-503646c74f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:48.891655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d6d46-55f9-46fe-8b23-a591a0c86e26 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:48.893061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7830d-e975-442c-a826-503646c74f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:48.894175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7830d-e975-442c-a826-503646c74f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:48.896730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7830d-e975-442c-a826-503646c74f8d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:48.922085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc5e38-d3db-4455-a3c3-2e4c49a26994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:48.925829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc5e38-d3db-4455-a3c3-2e4c49a26994 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:48.929846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc5e38-d3db-4455-a3c3-2e4c49a26994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:48.930849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc5e38-d3db-4455-a3c3-2e4c49a26994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:48.933367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc5e38-d3db-4455-a3c3-2e4c49a26994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:48.938427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc5e38-d3db-4455-a3c3-2e4c49a26994 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:48.957576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1176/2379] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:48 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:48.959072 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7830d-e975-442c-a826-503646c74f8d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:48.975065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1204/2380] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:48.977499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc5e38-d3db-4455-a3c3-2e4c49a26994 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:48.998583 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc5e38-d3db-4455-a3c3-2e4c49a26994 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:49.089933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7830d-e975-442c-a826-503646c74f8d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:49.102298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eaa5b-3ece-4fd1-8891-ab8e508094c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:49.103029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eaa5b-3ece-4fd1-8891-ab8e508094c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:49.103386 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eaa5b-3ece-4fd1-8891-ab8e508094c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:49.103604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941eaa5b-3ece-4fd1-8891-ab8e508094c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:49.104229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eaa5b-3ece-4fd1-8891-ab8e508094c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:49.106205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941eaa5b-3ece-4fd1-8891-ab8e508094c5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:49.141666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fd701-3677-4785-bffd-a2d47d5f99c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:49.142791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fd701-3677-4785-bffd-a2d47d5f99c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:49.143437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fd701-3677-4785-bffd-a2d47d5f99c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:49.143945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fd701-3677-4785-bffd-a2d47d5f99c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:49.146022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fd701-3677-4785-bffd-a2d47d5f99c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:49.149008 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fd701-3677-4785-bffd-a2d47d5f99c5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:49.160619 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1177/2381] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:48 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:49.164773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1205/2382] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:49.165096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eaa5b-3ece-4fd1-8891-ab8e508094c5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:49.168630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fd701-3677-4785-bffd-a2d47d5f99c5 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:49.180347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fd701-3677-4785-bffd-a2d47d5f99c5 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:49.188507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471cc8-ace5-4c27-a56a-4a3973b00675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:49.189894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471cc8-ace5-4c27-a56a-4a3973b00675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:49.190491 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471cc8-ace5-4c27-a56a-4a3973b00675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:49.190981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471cc8-ace5-4c27-a56a-4a3973b00675 admin admin] PATH_INFO: `/v3/projects/0e6ffbcd90f749bfb935dcb1be3cb48d/users/113aa91c5988412a835a3ae399bf3e16/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:49.194301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941eaa5b-3ece-4fd1-8891-ab8e508094c5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:49.212252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9471cc8-ace5-4c27-a56a-4a3973b00675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6ffbcd90f749bfb935dcb1be3cb48d, user_id=113aa91c5988412a835a3ae399bf3e16, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:49.216070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9471cc8-ace5-4c27-a56a-4a3973b00675 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:49.216751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd23ba2-0185-4b83-8090-70c0803bc817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:49.217460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd23ba2-0185-4b83-8090-70c0803bc817 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:49.217747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd23ba2-0185-4b83-8090-70c0803bc817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:49.218029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd23ba2-0185-4b83-8090-70c0803bc817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:49.218788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd23ba2-0185-4b83-8090-70c0803bc817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:49.220451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd23ba2-0185-4b83-8090-70c0803bc817 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:49.240433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1206/2383] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:49 2022] PUT /identity/v3/projects/0e6ffbcd90f749bfb935dcb1be3cb48d/users/113aa91c5988412a835a3ae399bf3e16/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:49.241430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1178/2384] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:09:49.246052 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471cc8-ace5-4c27-a56a-4a3973b00675 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:49.249172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fea022-a763-4f18-b9f3-9130387b2837 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:49.249477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fea022-a763-4f18-b9f3-9130387b2837 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:49.249717 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fea022-a763-4f18-b9f3-9130387b2837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:49.283839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-94fea022-a763-4f18-b9f3-9130387b2837 None None] MFA Rules not processed for user `113aa91c5988412a835a3ae399bf3e16`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:49.285126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-94fea022-a763-4f18-b9f3-9130387b2837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:49.290874 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:49.360632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471cc8-ace5-4c27-a56a-4a3973b00675 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:49.366398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa0267-2c5a-4021-b252-f6ac8baa7e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:49.367655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa0267-2c5a-4021-b252-f6ac8baa7e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:49.367942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa0267-2c5a-4021-b252-f6ac8baa7e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:49.368295 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa0267-2c5a-4021-b252-f6ac8baa7e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:49.369135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa0267-2c5a-4021-b252-f6ac8baa7e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:49.371637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa0267-2c5a-4021-b252-f6ac8baa7e8c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:49.389042 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1207/2385] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:09:49.390541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa0267-2c5a-4021-b252-f6ac8baa7e8c admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:49.405994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa0267-2c5a-4021-b252-f6ac8baa7e8c admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:49.411829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3114aa0-c4d2-4129-90e3-7eca2f5e6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:49.412918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114aa0-c4d2-4129-90e3-7eca2f5e6bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:49.413334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114aa0-c4d2-4129-90e3-7eca2f5e6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:49.413505 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114aa0-c4d2-4129-90e3-7eca2f5e6bb4 admin admin] PATH_INFO: `/v3/projects/24de02a2a26e436baba194302947d876/users/62995b3a22de47789f679022597ce15b/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:49.432474 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3114aa0-c4d2-4129-90e3-7eca2f5e6bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24de02a2a26e436baba194302947d876, user_id=62995b3a22de47789f679022597ce15b, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:49.433163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1179/2386] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:49.441214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3114aa0-c4d2-4129-90e3-7eca2f5e6bb4 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:49.446246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fea022-a763-4f18-b9f3-9130387b2837 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:49.448117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-94fea022-a763-4f18-b9f3-9130387b2837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:49.478438 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1208/2387] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:49 2022] PUT /identity/v3/projects/24de02a2a26e436baba194302947d876/users/62995b3a22de47789f679022597ce15b/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:49.488834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c11b-d7b3-4519-a50d-c7da1b0d21f1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:49.489125 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c11b-d7b3-4519-a50d-c7da1b0d21f1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:49.489419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c11b-d7b3-4519-a50d-c7da1b0d21f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:49.544919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-2a23c11b-d7b3-4519-a50d-c7da1b0d21f1 None None] MFA Rules not processed for user `62995b3a22de47789f679022597ce15b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:49.546153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2a23c11b-d7b3-4519-a50d-c7da1b0d21f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:49.557038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:49.608100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fea022-a763-4f18-b9f3-9130387b2837 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:49.672098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1209/2388] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:49.677747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23c11b-d7b3-4519-a50d-c7da1b0d21f1 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:49.721516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099d922-b5a3-4301-9b9c-e3c9b10c24d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:49.722556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099d922-b5a3-4301-9b9c-e3c9b10c24d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:49.723058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099d922-b5a3-4301-9b9c-e3c9b10c24d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:49.723642 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099d922-b5a3-4301-9b9c-e3c9b10c24d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:49.795413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099d922-b5a3-4301-9b9c-e3c9b10c24d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:49.797225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099d922-b5a3-4301-9b9c-e3c9b10c24d1 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:49.809034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1180/2389] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:09:49.837778 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23c11b-d7b3-4519-a50d-c7da1b0d21f1 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:49.843885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8409-13e1-43e3-9914-bdd9c989ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:49.844856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8409-13e1-43e3-9914-bdd9c989ff7b admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:49.845245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8409-13e1-43e3-9914-bdd9c989ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:49.845622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8409-13e1-43e3-9914-bdd9c989ff7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:49.846535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff8409-13e1-43e3-9914-bdd9c989ff7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:49.848799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff8409-13e1-43e3-9914-bdd9c989ff7b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:49.893329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1210/2390] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:49 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:49.897597 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099d922-b5a3-4301-9b9c-e3c9b10c24d1 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:49.924877 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099d922-b5a3-4301-9b9c-e3c9b10c24d1 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:49.950263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:50.013436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c24b97-b591-40ee-9808-532ca35ac286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:50.014245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c24b97-b591-40ee-9808-532ca35ac286 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:50.014675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c24b97-b591-40ee-9808-532ca35ac286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:50.015329 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c24b97-b591-40ee-9808-532ca35ac286 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:50.016160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c24b97-b591-40ee-9808-532ca35ac286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:50.018367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c24b97-b591-40ee-9808-532ca35ac286 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:50.082064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1181/2391] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:49 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:50.092833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8409-13e1-43e3-9914-bdd9c989ff7b admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:50.135072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8409-13e1-43e3-9914-bdd9c989ff7b admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:50.155765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cea7b-16ab-40f6-9230-bda8bd6300d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:50.156487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cea7b-16ab-40f6-9230-bda8bd6300d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:50.156794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cea7b-16ab-40f6-9230-bda8bd6300d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:50.157079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cea7b-16ab-40f6-9230-bda8bd6300d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:50.157838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cea7b-16ab-40f6-9230-bda8bd6300d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:50.159523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cea7b-16ab-40f6-9230-bda8bd6300d8 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:50.198191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1211/2392] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:50.202303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c24b97-b591-40ee-9808-532ca35ac286 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:50.216209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c24b97-b591-40ee-9808-532ca35ac286 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:50.241918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc045a-8f9e-4bd8-b5d1-f22cde934782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:50.242766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc045a-8f9e-4bd8-b5d1-f22cde934782 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:50.243061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc045a-8f9e-4bd8-b5d1-f22cde934782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:50.243340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc045a-8f9e-4bd8-b5d1-f22cde934782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:50.244098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc045a-8f9e-4bd8-b5d1-f22cde934782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:50.245884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc045a-8f9e-4bd8-b5d1-f22cde934782 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:50.293621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1182/2393] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:50.297143 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cea7b-16ab-40f6-9230-bda8bd6300d8 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:50.310316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cea7b-16ab-40f6-9230-bda8bd6300d8 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:50.315821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03494417-1704-4ca8-8c37-73bc9e626535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:50.316886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03494417-1704-4ca8-8c37-73bc9e626535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:50.317280 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03494417-1704-4ca8-8c37-73bc9e626535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:50.317730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03494417-1704-4ca8-8c37-73bc9e626535 admin admin] PATH_INFO: `/v3/projects/d1e8307df40b452baeda51377a1b0739/users/111b0896fbf84ca3960e985f62de1914/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:50.345758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03494417-1704-4ca8-8c37-73bc9e626535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e8307df40b452baeda51377a1b0739, user_id=111b0896fbf84ca3960e985f62de1914, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:50.349525 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03494417-1704-4ca8-8c37-73bc9e626535 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:50.372367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1212/2394] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:50 2022] PUT /identity/v3/projects/d1e8307df40b452baeda51377a1b0739/users/111b0896fbf84ca3960e985f62de1914/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:50.379998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467334-1735-4fa2-bc66-96d754621527 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:50.380407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467334-1735-4fa2-bc66-96d754621527 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:50.380585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89467334-1735-4fa2-bc66-96d754621527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:50.446373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-89467334-1735-4fa2-bc66-96d754621527 None None] MFA Rules not processed for user `111b0896fbf84ca3960e985f62de1914`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:50.447595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-89467334-1735-4fa2-bc66-96d754621527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:50.617799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1183/2395] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:50.622589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03494417-1704-4ca8-8c37-73bc9e626535 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:50.732851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03494417-1704-4ca8-8c37-73bc9e626535 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:50.737966 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee37a5-3a9b-4e53-b1b6-0981ab25f567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:50.738667 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee37a5-3a9b-4e53-b1b6-0981ab25f567 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:50.738906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee37a5-3a9b-4e53-b1b6-0981ab25f567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:50.739184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee37a5-3a9b-4e53-b1b6-0981ab25f567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:50.739896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee37a5-3a9b-4e53-b1b6-0981ab25f567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:50.742342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee37a5-3a9b-4e53-b1b6-0981ab25f567 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:50.745884 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:50.799263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1213/2396] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:09:50 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:50.801261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89467334-1735-4fa2-bc66-96d754621527 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:50.815840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89467334-1735-4fa2-bc66-96d754621527 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:50.889065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff3fd9-ab1b-4f23-ab6c-c09c0526d6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:50.889905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff3fd9-ab1b-4f23-ab6c-c09c0526d6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:50.890203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff3fd9-ab1b-4f23-ab6c-c09c0526d6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:50.890490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff3fd9-ab1b-4f23-ab6c-c09c0526d6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:50.891295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff3fd9-ab1b-4f23-ab6c-c09c0526d6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:50.893501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff3fd9-ab1b-4f23-ab6c-c09c0526d6f5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:50.921583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1184/2397] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:09:50 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:09:50.922773 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee37a5-3a9b-4e53-b1b6-0981ab25f567 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:50.934449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee37a5-3a9b-4e53-b1b6-0981ab25f567 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:50.939179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf74bf-9442-4184-bab4-15f85ed2b069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:50.939852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf74bf-9442-4184-bab4-15f85ed2b069 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:50.940139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf74bf-9442-4184-bab4-15f85ed2b069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:50.940450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf74bf-9442-4184-bab4-15f85ed2b069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:50.941348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf74bf-9442-4184-bab4-15f85ed2b069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:50.943040 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf74bf-9442-4184-bab4-15f85ed2b069 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:50.968541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1214/2398] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:50.972900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff3fd9-ab1b-4f23-ab6c-c09c0526d6f5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:50.990565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff3fd9-ab1b-4f23-ab6c-c09c0526d6f5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:51.003301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb92a9-be5f-4178-915e-2ed81bc9b1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:51.004219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb92a9-be5f-4178-915e-2ed81bc9b1d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:51.004620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb92a9-be5f-4178-915e-2ed81bc9b1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:51.005110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb92a9-be5f-4178-915e-2ed81bc9b1d0 admin admin] PATH_INFO: `/v3/projects/f4a7d395acec4d5ca850dddfcccdcadc/users/6a1e1063f5964adc985dd8263c540e8d/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:51.038777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:51.042784 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb92a9-be5f-4178-915e-2ed81bc9b1d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a7d395acec4d5ca850dddfcccdcadc, user_id=6a1e1063f5964adc985dd8263c540e8d, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:51.046244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb92a9-be5f-4178-915e-2ed81bc9b1d0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:51.084410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1185/2399] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:50 2022] PUT /identity/v3/projects/f4a7d395acec4d5ca850dddfcccdcadc/users/6a1e1063f5964adc985dd8263c540e8d/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:51.089175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf74bf-9442-4184-bab4-15f85ed2b069 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:51.103541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf74bf-9442-4184-bab4-15f85ed2b069 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:51.201162 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d1564-d7e1-4b40-bc9b-ab4e437dcae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:51.202033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d1564-d7e1-4b40-bc9b-ab4e437dcae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:51.202200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d1564-d7e1-4b40-bc9b-ab4e437dcae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:51.202453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d1564-d7e1-4b40-bc9b-ab4e437dcae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:51.203268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d1564-d7e1-4b40-bc9b-ab4e437dcae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:51.205334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d1564-d7e1-4b40-bc9b-ab4e437dcae7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:51.227977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb92a9-be5f-4178-915e-2ed81bc9b1d0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:51.241554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1215/2400] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:09:51.255918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb92a9-be5f-4178-915e-2ed81bc9b1d0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:51.262311 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aac912-2da1-4dc5-bb7b-c2a7bb954c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:51.263293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac912-2da1-4dc5-bb7b-c2a7bb954c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:51.263578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac912-2da1-4dc5-bb7b-c2a7bb954c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:51.263863 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aac912-2da1-4dc5-bb7b-c2a7bb954c43 admin admin] PATH_INFO: `/v3/projects/f4a7d395acec4d5ca850dddfcccdcadc/users/6a1e1063f5964adc985dd8263c540e8d/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:51.265987 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aac912-2da1-4dc5-bb7b-c2a7bb954c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a7d395acec4d5ca850dddfcccdcadc, user_id=6a1e1063f5964adc985dd8263c540e8d, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:51.269227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aac912-2da1-4dc5-bb7b-c2a7bb954c43 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:51.283003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1186/2401] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:09:51 2022] PUT /identity/v3/projects/f4a7d395acec4d5ca850dddfcccdcadc/users/6a1e1063f5964adc985dd8263c540e8d/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:51.295247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a42afc-4b01-4f01-9a76-b309e1eb22a7 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:51.295566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a42afc-4b01-4f01-9a76-b309e1eb22a7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:51.295801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a42afc-4b01-4f01-9a76-b309e1eb22a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:51.325683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-02a42afc-4b01-4f01-9a76-b309e1eb22a7 None None] MFA Rules not processed for user `6a1e1063f5964adc985dd8263c540e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:51.326919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-02a42afc-4b01-4f01-9a76-b309e1eb22a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:51.410346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1216/2402] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:51.427434 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aac912-2da1-4dc5-bb7b-c2a7bb954c43 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:51.429501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-94aac912-2da1-4dc5-bb7b-c2a7bb954c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:51.514025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aac912-2da1-4dc5-bb7b-c2a7bb954c43 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:51.521902 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cead0-07df-43f5-9bb2-f72a168eec72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:51.523210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cead0-07df-43f5-9bb2-f72a168eec72 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:51.523568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cead0-07df-43f5-9bb2-f72a168eec72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:51.524126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cead0-07df-43f5-9bb2-f72a168eec72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:51.595371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cead0-07df-43f5-9bb2-f72a168eec72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:51.596881 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cead0-07df-43f5-9bb2-f72a168eec72 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:51.609154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1187/2403] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:53.487672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a42afc-4b01-4f01-9a76-b309e1eb22a7 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:53.498204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a42afc-4b01-4f01-9a76-b309e1eb22a7 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:53.502107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203db5f-45ad-4a48-b3ce-441bd44d2b5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:53.502813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203db5f-45ad-4a48-b3ce-441bd44d2b5e service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:53.503204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203db5f-45ad-4a48-b3ce-441bd44d2b5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:53.503543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203db5f-45ad-4a48-b3ce-441bd44d2b5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:53.576542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:53.578010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203db5f-45ad-4a48-b3ce-441bd44d2b5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:53.579943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203db5f-45ad-4a48-b3ce-441bd44d2b5e service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:53.593262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1217/2404] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:54.616769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cead0-07df-43f5-9bb2-f72a168eec72 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:54.625982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cead0-07df-43f5-9bb2-f72a168eec72 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:54.629757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def0959-0e50-42a3-8b26-009bcce24b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:54.630414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0959-0e50-42a3-8b26-009bcce24b8a service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:54.630700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0959-0e50-42a3-8b26-009bcce24b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:54.630979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def0959-0e50-42a3-8b26-009bcce24b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:54.640850 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def0959-0e50-42a3-8b26-009bcce24b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:54.642297 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def0959-0e50-42a3-8b26-009bcce24b8a service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:54.653832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1188/2405] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:58.558592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203db5f-45ad-4a48-b3ce-441bd44d2b5e service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:58.635533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203db5f-45ad-4a48-b3ce-441bd44d2b5e service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:58.640098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:58.641006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:58.641296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:58.641575 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] PATH_INFO: `/v3/users/62995b3a22de47789f679022597ce15b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:58.642769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=62995b3a22de47789f679022597ce15b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:58.645022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:58.692650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62995b3a22de47789f679022597ce15b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:58.699858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62995b3a22de47789f679022597ce15b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:58.700549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62995b3a22de47789f679022597ce15b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:58.701158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62995b3a22de47789f679022597ce15b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:58.714806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62995b3a22de47789f679022597ce15b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:58.729103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1218/2406] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:58 2022] DELETE /identity/v3/users/62995b3a22de47789f679022597ce15b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:58.733578 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468ddf-578b-40d0-a185-399e460e3f9c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:58.734141 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468ddf-578b-40d0-a185-399e460e3f9c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:58.734248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468ddf-578b-40d0-a185-399e460e3f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:58.751178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f7468ddf-578b-40d0-a185-399e460e3f9c None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:09:58.752518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f7468ddf-578b-40d0-a185-399e460e3f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:58.828198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1189/2407] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:09:58.840372 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:58.841866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:58.935482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541a773-8d53-46de-9592-ba005717df3a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:58.940086 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bab24-11ba-4efa-b967-8595bb2993d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:58.940849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bab24-11ba-4efa-b967-8595bb2993d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:58.941381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bab24-11ba-4efa-b967-8595bb2993d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:58.941731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bab24-11ba-4efa-b967-8595bb2993d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:58.954153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bab24-11ba-4efa-b967-8595bb2993d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:58.955778 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bab24-11ba-4efa-b967-8595bb2993d2 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:58.968776 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1219/2408] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:09:59.432681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7468ddf-578b-40d0-a185-399e460e3f9c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:59.440425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f7468ddf-578b-40d0-a185-399e460e3f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:09:59.477400 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7468ddf-578b-40d0-a185-399e460e3f9c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:59.488386 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:59.489589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:59.490077 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:59.490415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] PATH_INFO: `/v3/projects/24de02a2a26e436baba194302947d876` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:59.493013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24de02a2a26e436baba194302947d876)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:59.495726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:59.540490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:59.599249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24de02a2a26e436baba194302947d876', 'request_id': 'req-12f87e07-6c70-4f5b-907b-ab98aa3351d2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:59.607893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24de02a2a26e436baba194302947d876', 'request_id': 'req-12f87e07-6c70-4f5b-907b-ab98aa3351d2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:59.619254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24de02a2a26e436baba194302947d876', 'request_id': 'req-12f87e07-6c70-4f5b-907b-ab98aa3351d2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:59.636566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] The token cache is being invalidate because project 24de02a2a26e436baba194302947d876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:09:59.636925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:59.637690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:59.643086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1190/2409] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:09:59 2022] DELETE /identity/v3/projects/24de02a2a26e436baba194302947d876 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:09:59.643853 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bab24-11ba-4efa-b967-8595bb2993d2 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:09:59.651975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:59.657335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bab24-11ba-4efa-b967-8595bb2993d2 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:09:59.718109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:09:59.718980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:09:59.719267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:09:59.719543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] PATH_INFO: `/v3/users/111b0896fbf84ca3960e985f62de1914` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:09:59.720758 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111b0896fbf84ca3960e985f62de1914)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:09:59.722685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:09:59.767088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111b0896fbf84ca3960e985f62de1914'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:59.774261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111b0896fbf84ca3960e985f62de1914'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:59.774939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111b0896fbf84ca3960e985f62de1914'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:59.775547 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111b0896fbf84ca3960e985f62de1914'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:59.789707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111b0896fbf84ca3960e985f62de1914'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:09:59.801910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1220/2410] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:09:59 2022] DELETE /identity/v3/users/111b0896fbf84ca3960e985f62de1914 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:10:00.089389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:00.091104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:00.110745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f87e07-6c70-4f5b-907b-ab98aa3351d2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:00.174081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:00.174961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:00.175271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:00.175525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] PATH_INFO: `/v3/projects/d1e8307df40b452baeda51377a1b0739` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:00.176899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e8307df40b452baeda51377a1b0739)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:00.178899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:00.223636 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e8307df40b452baeda51377a1b0739', 'request_id': 'req-525e1036-f5ea-459c-a90a-0fa67ec500e8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:00.229499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e8307df40b452baeda51377a1b0739', 'request_id': 'req-525e1036-f5ea-459c-a90a-0fa67ec500e8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:00.236682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e8307df40b452baeda51377a1b0739', 'request_id': 'req-525e1036-f5ea-459c-a90a-0fa67ec500e8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:00.248002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] The token cache is being invalidate because project d1e8307df40b452baeda51377a1b0739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:10:00.248296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:00.248975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:00.250521 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1191/2411] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:10:00 2022] DELETE /identity/v3/projects/d1e8307df40b452baeda51377a1b0739 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:10:00.254441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:00.255834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:00.268558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c655654-647f-4598-a514-0288182c8ae6 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:00.323640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372f4f2-9b1b-42af-acb4-9ad8073526f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:00.324540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f4f2-9b1b-42af-acb4-9ad8073526f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:00.324825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f4f2-9b1b-42af-acb4-9ad8073526f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:00.325103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f4f2-9b1b-42af-acb4-9ad8073526f9 admin admin] PATH_INFO: `/v3/users/6a1e1063f5964adc985dd8263c540e8d` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:00.326271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372f4f2-9b1b-42af-acb4-9ad8073526f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1e1063f5964adc985dd8263c540e8d)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:00.328212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372f4f2-9b1b-42af-acb4-9ad8073526f9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:00.356580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:00.376854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f372f4f2-9b1b-42af-acb4-9ad8073526f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1e1063f5964adc985dd8263c540e8d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:00.385104 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f372f4f2-9b1b-42af-acb4-9ad8073526f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1e1063f5964adc985dd8263c540e8d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:00.385817 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f372f4f2-9b1b-42af-acb4-9ad8073526f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1e1063f5964adc985dd8263c540e8d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:00.386425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f372f4f2-9b1b-42af-acb4-9ad8073526f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1e1063f5964adc985dd8263c540e8d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:00.399883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-f372f4f2-9b1b-42af-acb4-9ad8073526f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1e1063f5964adc985dd8263c540e8d'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:00.419364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1221/2412] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:10:00 2022] DELETE /identity/v3/users/6a1e1063f5964adc985dd8263c540e8d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:10:00.883356 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:00.885232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:00.910231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e1036-f5ea-459c-a90a-0fa67ec500e8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:00.955408 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:00.993175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:00.993943 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:00.994223 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:00.994500 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] PATH_INFO: `/v3/projects/f4a7d395acec4d5ca850dddfcccdcadc` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:00.996624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a7d395acec4d5ca850dddfcccdcadc)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:00.998869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:01.055448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a7d395acec4d5ca850dddfcccdcadc', 'request_id': 'req-74f38173-9342-4aa5-a68c-123fd91b191d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:01.068347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a7d395acec4d5ca850dddfcccdcadc', 'request_id': 'req-74f38173-9342-4aa5-a68c-123fd91b191d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:01.078312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a7d395acec4d5ca850dddfcccdcadc', 'request_id': 'req-74f38173-9342-4aa5-a68c-123fd91b191d'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:01.090332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] The token cache is being invalidate because project f4a7d395acec4d5ca850dddfcccdcadc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:10:01.090939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:01.091290 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-74f38173-9342-4aa5-a68c-123fd91b191d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:01.092882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1192/2413] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:10:00 2022] DELETE /identity/v3/projects/f4a7d395acec4d5ca850dddfcccdcadc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:10:01.097732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac782-a006-4cbe-a85e-32484beeeaa2 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:01.098225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac782-a006-4cbe-a85e-32484beeeaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:01.098414 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dac782-a006-4cbe-a85e-32484beeeaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:01.130439 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-91dac782-a006-4cbe-a85e-32484beeeaa2 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:01.132435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-91dac782-a006-4cbe-a85e-32484beeeaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:01.195457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1222/2414] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:01.203083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af4c41-df83-439e-8846-07d580c55007 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:01.203371 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af4c41-df83-439e-8846-07d580c55007 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:01.203651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af4c41-df83-439e-8846-07d580c55007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:01.223223 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-47af4c41-df83-439e-8846-07d580c55007 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:01.224603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-47af4c41-df83-439e-8846-07d580c55007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:01.234030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1193/2415] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:01.238741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dac782-a006-4cbe-a85e-32484beeeaa2 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:01.249643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dac782-a006-4cbe-a85e-32484beeeaa2 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:01.254210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18935d-4b29-47d1-857f-ca1183bfc325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:01.254864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18935d-4b29-47d1-857f-ca1183bfc325 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:01.255143 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18935d-4b29-47d1-857f-ca1183bfc325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:01.255435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18935d-4b29-47d1-857f-ca1183bfc325 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:01.256342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18935d-4b29-47d1-857f-ca1183bfc325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:10:01.256782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18935d-4b29-47d1-857f-ca1183bfc325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:01.258395 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18935d-4b29-47d1-857f-ca1183bfc325 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:01.276286 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1223/2416] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:10:01.277882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af4c41-df83-439e-8846-07d580c55007 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:01.288193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af4c41-df83-439e-8846-07d580c55007 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:01.293574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96d90b-9b7e-4b11-bd8c-947fc3397d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:01.294410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96d90b-9b7e-4b11-bd8c-947fc3397d86 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:01.294675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96d90b-9b7e-4b11-bd8c-947fc3397d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:01.295018 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96d90b-9b7e-4b11-bd8c-947fc3397d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:01.295740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96d90b-9b7e-4b11-bd8c-947fc3397d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:01.297886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96d90b-9b7e-4b11-bd8c-947fc3397d86 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:01.327161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1194/2417] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:10:01 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:10:01.328436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18935d-4b29-47d1-857f-ca1183bfc325 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:01.341397 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18935d-4b29-47d1-857f-ca1183bfc325 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:01.424100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b637b8-0d4b-4bc8-ac3e-3b6bf2d735af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:01.424863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b637b8-0d4b-4bc8-ac3e-3b6bf2d735af admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:01.425149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b637b8-0d4b-4bc8-ac3e-3b6bf2d735af admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:01.425512 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b637b8-0d4b-4bc8-ac3e-3b6bf2d735af admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:01.426272 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b637b8-0d4b-4bc8-ac3e-3b6bf2d735af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:01.429270 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b637b8-0d4b-4bc8-ac3e-3b6bf2d735af admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:01.456370 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1224/2418] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:10:01 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:10:01.458470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96d90b-9b7e-4b11-bd8c-947fc3397d86 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:01.471770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96d90b-9b7e-4b11-bd8c-947fc3397d86 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:01.485089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293b169-75dc-426d-814c-879b45587a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:01.486040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b169-75dc-426d-814c-879b45587a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:01.486327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b169-75dc-426d-814c-879b45587a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:01.486644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b169-75dc-426d-814c-879b45587a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:01.487394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293b169-75dc-426d-814c-879b45587a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:01.489226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293b169-75dc-426d-814c-879b45587a43 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:01.504583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1195/2419] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:10:01.506318 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b637b8-0d4b-4bc8-ac3e-3b6bf2d735af admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:01.517259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b637b8-0d4b-4bc8-ac3e-3b6bf2d735af admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:01.525813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba67550-0371-498e-8cd2-b46e5afba6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:01.526637 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba67550-0371-498e-8cd2-b46e5afba6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:01.527032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba67550-0371-498e-8cd2-b46e5afba6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:01.527422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba67550-0371-498e-8cd2-b46e5afba6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:01.528274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba67550-0371-498e-8cd2-b46e5afba6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:01.530038 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba67550-0371-498e-8cd2-b46e5afba6d0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:01.536603 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:01.546668 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1225/2420] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:10:01.550925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293b169-75dc-426d-814c-879b45587a43 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:01.566763 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293b169-75dc-426d-814c-879b45587a43 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:01.591094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dac52e-652d-437b-b5c0-7c0063aae88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:01.592154 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dac52e-652d-437b-b5c0-7c0063aae88e admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:01.593210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dac52e-652d-437b-b5c0-7c0063aae88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:01.593210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dac52e-652d-437b-b5c0-7c0063aae88e admin admin] PATH_INFO: `/v3/projects/50357e34e2294f7ab3f80593e286e0e3/users/93bfd48d2e0a4a1d815a377657c50d35/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:01.622533 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dac52e-652d-437b-b5c0-7c0063aae88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50357e34e2294f7ab3f80593e286e0e3, user_id=93bfd48d2e0a4a1d815a377657c50d35, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:01.625865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dac52e-652d-437b-b5c0-7c0063aae88e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:01.674921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1196/2421] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:10:01 2022] PUT /identity/v3/projects/50357e34e2294f7ab3f80593e286e0e3/users/93bfd48d2e0a4a1d815a377657c50d35/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:10:01.685866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfa981-f3a0-4c52-91c6-450179bb6442 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:01.686157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfa981-f3a0-4c52-91c6-450179bb6442 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:01.686441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfa981-f3a0-4c52-91c6-450179bb6442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:01.720266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-9bbfa981-f3a0-4c52-91c6-450179bb6442 None None] MFA Rules not processed for user `93bfd48d2e0a4a1d815a377657c50d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:01.721672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9bbfa981-f3a0-4c52-91c6-450179bb6442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:01.800966 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1226/2422] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:01.812055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dac52e-652d-437b-b5c0-7c0063aae88e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:01.813919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-52dac52e-652d-437b-b5c0-7c0063aae88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:01.882172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dac52e-652d-437b-b5c0-7c0063aae88e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:01.889225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5fa81-48c9-48bb-aba6-95919a50e438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:01.889903 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5fa81-48c9-48bb-aba6-95919a50e438 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:01.890185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5fa81-48c9-48bb-aba6-95919a50e438 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:01.890459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5fa81-48c9-48bb-aba6-95919a50e438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:01.901021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5fa81-48c9-48bb-aba6-95919a50e438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:01.902479 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5fa81-48c9-48bb-aba6-95919a50e438 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:01.913913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1197/2423] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:10:02.767371 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfa981-f3a0-4c52-91c6-450179bb6442 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:02.769305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9bbfa981-f3a0-4c52-91c6-450179bb6442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:02.838885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfa981-f3a0-4c52-91c6-450179bb6442 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:02.843408 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec8cb2-2dc2-4b7b-a998-3efea6ec3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:02.844282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8cb2-2dc2-4b7b-a998-3efea6ec3647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:02.844598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8cb2-2dc2-4b7b-a998-3efea6ec3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:02.844877 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec8cb2-2dc2-4b7b-a998-3efea6ec3647 admin admin] PATH_INFO: `/v3/users/fcea4a42269949f5b2b21f2613985041` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:02.846063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec8cb2-2dc2-4b7b-a998-3efea6ec3647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcea4a42269949f5b2b21f2613985041)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:02.848186 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec8cb2-2dc2-4b7b-a998-3efea6ec3647 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:02.902591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-87ec8cb2-2dc2-4b7b-a998-3efea6ec3647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcea4a42269949f5b2b21f2613985041'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:02.910120 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-87ec8cb2-2dc2-4b7b-a998-3efea6ec3647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcea4a42269949f5b2b21f2613985041'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:02.910822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-87ec8cb2-2dc2-4b7b-a998-3efea6ec3647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcea4a42269949f5b2b21f2613985041'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:02.911475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-87ec8cb2-2dc2-4b7b-a998-3efea6ec3647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcea4a42269949f5b2b21f2613985041'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:02.926027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-87ec8cb2-2dc2-4b7b-a998-3efea6ec3647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcea4a42269949f5b2b21f2613985041'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:02.942316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1227/2424] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:10:02 2022] DELETE /identity/v3/users/fcea4a42269949f5b2b21f2613985041 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:10:02.947225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cdef3-bb99-4cf4-986e-bc61e454c3a9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:02.947682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cdef3-bb99-4cf4-986e-bc61e454c3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:02.947972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cdef3-bb99-4cf4-986e-bc61e454c3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:02.953445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8317490-828f-4279-bd75-32fe24c7b7c6 None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:02.954158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:02.954813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8317490-828f-4279-bd75-32fe24c7b7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:02.955512 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8317490-828f-4279-bd75-32fe24c7b7c6 None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:02.957126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1228/2425] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:10:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:10:02.963179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387b16f-f54d-436c-8d67-8ec4acb0353a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:02.963521 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387b16f-f54d-436c-8d67-8ec4acb0353a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:02.963803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387b16f-f54d-436c-8d67-8ec4acb0353a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:02.972092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c43cdef3-bb99-4cf4-986e-bc61e454c3a9 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:02.973872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c43cdef3-bb99-4cf4-986e-bc61e454c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:02.975745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:02.995995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c387b16f-f54d-436c-8d67-8ec4acb0353a None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:02.997264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c387b16f-f54d-436c-8d67-8ec4acb0353a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:03.051029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1198/2426] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:03.065052 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cdef3-bb99-4cf4-986e-bc61e454c3a9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:03.067199 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c43cdef3-bb99-4cf4-986e-bc61e454c3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:03.085627 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1229/2427] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:10:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:10:03.108947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387b16f-f54d-436c-8d67-8ec4acb0353a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:03.110497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c387b16f-f54d-436c-8d67-8ec4acb0353a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:03.146437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cdef3-bb99-4cf4-986e-bc61e454c3a9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:03.151016 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cdf60-201c-40e8-90e7-690a9a3338b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:03.151697 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cdf60-201c-40e8-90e7-690a9a3338b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.151973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cdf60-201c-40e8-90e7-690a9a3338b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.152260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cdf60-201c-40e8-90e7-690a9a3338b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.162489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228cdf60-201c-40e8-90e7-690a9a3338b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:03.164501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228cdf60-201c-40e8-90e7-690a9a3338b7 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:03.174677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1199/2428] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:10:03.178000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387b16f-f54d-436c-8d67-8ec4acb0353a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:03.181757 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1e74e-863b-4276-8f14-368c062dfb89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f36041751a446885608f5a3b1f37df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:03.182433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1e74e-863b-4276-8f14-368c062dfb89 service glance] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.182716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1e74e-863b-4276-8f14-368c062dfb89 service glance] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.182998 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1e74e-863b-4276-8f14-368c062dfb89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.194022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1e74e-863b-4276-8f14-368c062dfb89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:03.195469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1e74e-863b-4276-8f14-368c062dfb89 service glance] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:03.208394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1230/2429] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:10:03.288443 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d090ec5-55a9-4155-b338-a243e2e402e1 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.288746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d090ec5-55a9-4155-b338-a243e2e402e1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.289022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d090ec5-55a9-4155-b338-a243e2e402e1 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.290565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1200/2430] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:10:03.297035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649dfc9-5289-4a1d-8c8e-5591976c8df1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.297321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649dfc9-5289-4a1d-8c8e-5591976c8df1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.297601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649dfc9-5289-4a1d-8c8e-5591976c8df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.322132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-9649dfc9-5289-4a1d-8c8e-5591976c8df1 None None] MFA Rules not processed for user `70b46194590c47c08c8d9d98904a2d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:03.335113 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9649dfc9-5289-4a1d-8c8e-5591976c8df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:03.344215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1231/2431] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:10:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:03.366574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d090ec5-55a9-4155-b338-a243e2e402e1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:03.381480 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d090ec5-55a9-4155-b338-a243e2e402e1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:03.386421 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8f734-5325-40c1-9caf-5cb66a59f421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:03.387204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f734-5325-40c1-9caf-5cb66a59f421 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.387490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f734-5325-40c1-9caf-5cb66a59f421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.387767 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f734-5325-40c1-9caf-5cb66a59f421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.399450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8f734-5325-40c1-9caf-5cb66a59f421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:03.401061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8f734-5325-40c1-9caf-5cb66a59f421 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:03.410927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1201/2432] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:10:03.441260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc38ef-b236-4197-88c6-5fffdf5263aa None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.441622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc38ef-b236-4197-88c6-5fffdf5263aa None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.441912 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc38ef-b236-4197-88c6-5fffdf5263aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.471861 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-abbc38ef-b236-4197-88c6-5fffdf5263aa None None] MFA Rules not processed for user `93bfd48d2e0a4a1d815a377657c50d35`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:03.473242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-abbc38ef-b236-4197-88c6-5fffdf5263aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:03.517421 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9369-0c1b-44c5-aa14-181a5f672cee None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.517846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9369-0c1b-44c5-aa14-181a5f672cee None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.518224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba9369-0c1b-44c5-aa14-181a5f672cee None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.520261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1202/2433] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:10:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 06:10:03.552360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afea7e-572e-42b5-ba84-266fed64dbd9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.552360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afea7e-572e-42b5-ba84-266fed64dbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.552360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afea7e-572e-42b5-ba84-266fed64dbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.552882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1232/2434] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:03.591900 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-74afea7e-572e-42b5-ba84-266fed64dbd9 None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:03.594085 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-74afea7e-572e-42b5-ba84-266fed64dbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:03.632286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1203/2435] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:10:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:03.644148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc38ef-b236-4197-88c6-5fffdf5263aa None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:03.646919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afea7e-572e-42b5-ba84-266fed64dbd9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:03.648851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-74afea7e-572e-42b5-ba84-266fed64dbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:03.660732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc38ef-b236-4197-88c6-5fffdf5263aa None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:03.664978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afea7e-572e-42b5-ba84-266fed64dbd9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:03.667403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951accf-4fe3-45c7-bb8d-d26b839b17ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:03.668064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951accf-4fe3-45c7-bb8d-d26b839b17ff service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.668481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951accf-4fe3-45c7-bb8d-d26b839b17ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.668870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951accf-4fe3-45c7-bb8d-d26b839b17ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.670043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:03.671442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.671974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.672342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] PATH_INFO: `/v3/projects/71ba5a1e5b72497cab8c582c3f539acc` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.673920 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ba5a1e5b72497cab8c582c3f539acc)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:03.677363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:03.684389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951accf-4fe3-45c7-bb8d-d26b839b17ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:03.686237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951accf-4fe3-45c7-bb8d-d26b839b17ff service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:03.710566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1233/2436] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:10:03.739904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ba5a1e5b72497cab8c582c3f539acc', 'request_id': 'req-31a93a81-e223-4e05-be16-a9ea9fcddecb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:03.747472 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ba5a1e5b72497cab8c582c3f539acc', 'request_id': 'req-31a93a81-e223-4e05-be16-a9ea9fcddecb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:03.760969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ba5a1e5b72497cab8c582c3f539acc', 'request_id': 'req-31a93a81-e223-4e05-be16-a9ea9fcddecb'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:03.778083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] The token cache is being invalidate because project 71ba5a1e5b72497cab8c582c3f539acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:10:03.778452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:03.779201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-31a93a81-e223-4e05-be16-a9ea9fcddecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:03.781127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1204/2437] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:10:03 2022] DELETE /identity/v3/projects/71ba5a1e5b72497cab8c582c3f539acc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:10:03.786184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e1e53-6909-4d18-aa9a-d8cac19dcde9 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.786613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e1e53-6909-4d18-aa9a-d8cac19dcde9 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.786806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e1e53-6909-4d18-aa9a-d8cac19dcde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.808205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d95e1e53-6909-4d18-aa9a-d8cac19dcde9 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:03.809413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d95e1e53-6909-4d18-aa9a-d8cac19dcde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:03.828077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:03.891048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1234/2438] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:03.900208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66fc0-b546-45d9-9762-6837ef7751cf None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.900544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66fc0-b546-45d9-9762-6837ef7751cf None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.900884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe66fc0-b546-45d9-9762-6837ef7751cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.930384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4fe66fc0-b546-45d9-9762-6837ef7751cf None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:03.931655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4fe66fc0-b546-45d9-9762-6837ef7751cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:03.943148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1205/2439] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:03.948199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e1e53-6909-4d18-aa9a-d8cac19dcde9 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:03.959967 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e1e53-6909-4d18-aa9a-d8cac19dcde9 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:03.966718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e937d-633c-453e-af7e-f876f435e394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:03.967723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e937d-633c-453e-af7e-f876f435e394 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:03.968028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e937d-633c-453e-af7e-f876f435e394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:03.968586 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e937d-633c-453e-af7e-f876f435e394 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:03.969538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e937d-633c-453e-af7e-f876f435e394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:10:03.969992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e937d-633c-453e-af7e-f876f435e394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:03.971806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e937d-633c-453e-af7e-f876f435e394 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:03.986651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1235/2440] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:10:03.991727 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe66fc0-b546-45d9-9762-6837ef7751cf None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:03.997014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:04.003847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe66fc0-b546-45d9-9762-6837ef7751cf None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:04.011978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03294382-fde4-4110-8805-3fe7906c99f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:04.012976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294382-fde4-4110-8805-3fe7906c99f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:04.013504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294382-fde4-4110-8805-3fe7906c99f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:04.013936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03294382-fde4-4110-8805-3fe7906c99f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:04.014821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03294382-fde4-4110-8805-3fe7906c99f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:04.016876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03294382-fde4-4110-8805-3fe7906c99f6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:04.051037 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1206/2441] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:10:03 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:10:04.056139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e937d-633c-453e-af7e-f876f435e394 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:04.077878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e937d-633c-453e-af7e-f876f435e394 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:04.204381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee60b69-e75f-4667-bb4a-5db04d8b5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:04.205078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee60b69-e75f-4667-bb4a-5db04d8b5db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:04.205316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee60b69-e75f-4667-bb4a-5db04d8b5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:04.205913 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee60b69-e75f-4667-bb4a-5db04d8b5db3 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:04.206903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee60b69-e75f-4667-bb4a-5db04d8b5db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:04.209909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee60b69-e75f-4667-bb4a-5db04d8b5db3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:04.252542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1236/2442] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:10:04 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:10:04.257992 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03294382-fde4-4110-8805-3fe7906c99f6 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:04.276952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03294382-fde4-4110-8805-3fe7906c99f6 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:04.282063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b46dfd-a884-488c-bd38-d046d3ef2100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:04.282745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b46dfd-a884-488c-bd38-d046d3ef2100 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:04.283323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b46dfd-a884-488c-bd38-d046d3ef2100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:04.283601 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b46dfd-a884-488c-bd38-d046d3ef2100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:04.284529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b46dfd-a884-488c-bd38-d046d3ef2100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:04.286323 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b46dfd-a884-488c-bd38-d046d3ef2100 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:04.301210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1207/2443] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:10:04.302269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee60b69-e75f-4667-bb4a-5db04d8b5db3 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:04.326702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee60b69-e75f-4667-bb4a-5db04d8b5db3 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:04.331687 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d73510-0d45-4433-b0a1-0beb08457d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:04.332386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73510-0d45-4433-b0a1-0beb08457d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:04.332676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73510-0d45-4433-b0a1-0beb08457d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:04.332954 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d73510-0d45-4433-b0a1-0beb08457d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:04.333909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d73510-0d45-4433-b0a1-0beb08457d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:04.335496 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d73510-0d45-4433-b0a1-0beb08457d03 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:04.346229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1237/2444] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:10:04.350904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b46dfd-a884-488c-bd38-d046d3ef2100 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:04.361737 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b46dfd-a884-488c-bd38-d046d3ef2100 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:04.369631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e55dd-3736-458a-97e6-111352280a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:04.370627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e55dd-3736-458a-97e6-111352280a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:04.370962 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e55dd-3736-458a-97e6-111352280a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:04.371370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e55dd-3736-458a-97e6-111352280a99 admin admin] PATH_INFO: `/v3/projects/d00acb6eb5f64310a8446e8f1f13a1e8/users/58b97e802e4c4e73933e34507e44aea7/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:04.390317 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e55dd-3736-458a-97e6-111352280a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00acb6eb5f64310a8446e8f1f13a1e8, user_id=58b97e802e4c4e73933e34507e44aea7, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:04.393169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e55dd-3736-458a-97e6-111352280a99 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:04.407277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1208/2445] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:10:04 2022] PUT /identity/v3/projects/d00acb6eb5f64310a8446e8f1f13a1e8/users/58b97e802e4c4e73933e34507e44aea7/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:10:04.412471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5b2bd-9667-46f3-b88f-2d28228e99e8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:04.413239 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5b2bd-9667-46f3-b88f-2d28228e99e8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:04.413545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5b2bd-9667-46f3-b88f-2d28228e99e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:04.443870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-15b5b2bd-9667-46f3-b88f-2d28228e99e8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:04.445308 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-15b5b2bd-9667-46f3-b88f-2d28228e99e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:04.532766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1238/2446] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:04.544869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e55dd-3736-458a-97e6-111352280a99 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:04.547043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-194e55dd-3736-458a-97e6-111352280a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:04.646585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e55dd-3736-458a-97e6-111352280a99 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:04.657812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e27ef-9ac1-48ec-a8ef-b5824e23fe43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:04.658907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e27ef-9ac1-48ec-a8ef-b5824e23fe43 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:04.659455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e27ef-9ac1-48ec-a8ef-b5824e23fe43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:04.659943 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e27ef-9ac1-48ec-a8ef-b5824e23fe43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:04.674770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e27ef-9ac1-48ec-a8ef-b5824e23fe43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:04.676714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e27ef-9ac1-48ec-a8ef-b5824e23fe43 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:04.691479 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1209/2447] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:10:09.758665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7aad-c34c-48b3-b680-80a4693068d8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:09.759153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7aad-c34c-48b3-b680-80a4693068d8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:09.759312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7aad-c34c-48b3-b680-80a4693068d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:09.793591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-dc5f7aad-c34c-48b3-b680-80a4693068d8 None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:09.794983 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-dc5f7aad-c34c-48b3-b680-80a4693068d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:09.821010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:09.882666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1239/2448] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:10:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:09.918965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e27ef-9ac1-48ec-a8ef-b5824e23fe43 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:09.920553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-333e27ef-9ac1-48ec-a8ef-b5824e23fe43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:10.007830 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e27ef-9ac1-48ec-a8ef-b5824e23fe43 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:10.012812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ef808-5719-45de-98b6-5e66f9f92980 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:10.013457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ef808-5719-45de-98b6-5e66f9f92980 service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:10.013742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ef808-5719-45de-98b6-5e66f9f92980 service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:10.014020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ef808-5719-45de-98b6-5e66f9f92980 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:10.022951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ef808-5719-45de-98b6-5e66f9f92980 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:10.024701 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ef808-5719-45de-98b6-5e66f9f92980 service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:10.035542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1210/2449] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:10:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:10:13.872615 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c134d-6af2-4c71-bf4a-dde0c0c403eb None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:13.873087 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c134d-6af2-4c71-bf4a-dde0c0c403eb None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:13.875979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c134d-6af2-4c71-bf4a-dde0c0c403eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:13.915649 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-869c134d-6af2-4c71-bf4a-dde0c0c403eb None None] MFA Rules not processed for user `58b97e802e4c4e73933e34507e44aea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:13.916908 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-869c134d-6af2-4c71-bf4a-dde0c0c403eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:14.028159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1240/2450] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:14.032726 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ef808-5719-45de-98b6-5e66f9f92980 service swift] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:14.076769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ef808-5719-45de-98b6-5e66f9f92980 service swift] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:14.099485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a5e6a-ad49-4bd1-b834-4a495c48e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:14.100825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5e6a-ad49-4bd1-b834-4a495c48e316 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:14.101343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5e6a-ad49-4bd1-b834-4a495c48e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:14.101862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5e6a-ad49-4bd1-b834-4a495c48e316 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:14.102890 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a5e6a-ad49-4bd1-b834-4a495c48e316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:14.105313 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a5e6a-ad49-4bd1-b834-4a495c48e316 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:14.149745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1211/2451] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:10:14 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:10:14.153712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c134d-6af2-4c71-bf4a-dde0c0c403eb None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:14.167053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c134d-6af2-4c71-bf4a-dde0c0c403eb None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:14.266402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026bc7c-f5f8-4e7e-bdf8-d0dc1fd1c0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:14.267354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026bc7c-f5f8-4e7e-bdf8-d0dc1fd1c0fa admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:14.267815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026bc7c-f5f8-4e7e-bdf8-d0dc1fd1c0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:14.268253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026bc7c-f5f8-4e7e-bdf8-d0dc1fd1c0fa admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:14.269158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026bc7c-f5f8-4e7e-bdf8-d0dc1fd1c0fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:14.272100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026bc7c-f5f8-4e7e-bdf8-d0dc1fd1c0fa admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:14.319556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1241/2452] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:10:14 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:10:14.326025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a5e6a-ad49-4bd1-b834-4a495c48e316 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:14.345604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a5e6a-ad49-4bd1-b834-4a495c48e316 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:14.355564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a123752-b3df-47e2-9fe9-cf43e31cc8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:14.356559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123752-b3df-47e2-9fe9-cf43e31cc8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:14.356964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123752-b3df-47e2-9fe9-cf43e31cc8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:14.357349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a123752-b3df-47e2-9fe9-cf43e31cc8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:14.358278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a123752-b3df-47e2-9fe9-cf43e31cc8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:14.360347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a123752-b3df-47e2-9fe9-cf43e31cc8c3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:14.381629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1212/2453] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:10:14.382727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026bc7c-f5f8-4e7e-bdf8-d0dc1fd1c0fa admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:14.399132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026bc7c-f5f8-4e7e-bdf8-d0dc1fd1c0fa admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:14.414584 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb50dd7-2efc-4a34-94c6-f3f66434368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:14.417304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb50dd7-2efc-4a34-94c6-f3f66434368d admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:14.417665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb50dd7-2efc-4a34-94c6-f3f66434368d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:14.417944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb50dd7-2efc-4a34-94c6-f3f66434368d admin admin] PATH_INFO: `/v3/projects/927855ba1a9845569ad811b5137117e2/users/fcae1b10d99d46d4ba0fe62d091d6ef4/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:14.436098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb50dd7-2efc-4a34-94c6-f3f66434368d admin admin] RBAC: Authorizing `identity:create_grant(project_id=927855ba1a9845569ad811b5137117e2, user_id=fcae1b10d99d46d4ba0fe62d091d6ef4, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:14.438928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb50dd7-2efc-4a34-94c6-f3f66434368d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:14.454485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1242/2454] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:10:14 2022] PUT /identity/v3/projects/927855ba1a9845569ad811b5137117e2/users/fcae1b10d99d46d4ba0fe62d091d6ef4/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:10:14.458175 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a123752-b3df-47e2-9fe9-cf43e31cc8c3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:14.464751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:14.471390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a123752-b3df-47e2-9fe9-cf43e31cc8c3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:14.581234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4774e0-c6b6-44ee-a4ac-ed247991cfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:14.581937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4774e0-c6b6-44ee-a4ac-ed247991cfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:14.583119 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4774e0-c6b6-44ee-a4ac-ed247991cfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:14.583485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4774e0-c6b6-44ee-a4ac-ed247991cfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:14.584493 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4774e0-c6b6-44ee-a4ac-ed247991cfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:14.586267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4774e0-c6b6-44ee-a4ac-ed247991cfd5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:14.616751 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb50dd7-2efc-4a34-94c6-f3f66434368d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:14.620066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1213/2455] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:10:14.641264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb50dd7-2efc-4a34-94c6-f3f66434368d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:14.653300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610abe2-6ced-4d12-a325-5534154e107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:14.656855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610abe2-6ced-4d12-a325-5534154e107d admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:14.657191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610abe2-6ced-4d12-a325-5534154e107d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:14.661085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610abe2-6ced-4d12-a325-5534154e107d admin admin] PATH_INFO: `/v3/projects/927855ba1a9845569ad811b5137117e2/users/fcae1b10d99d46d4ba0fe62d091d6ef4/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:14.667957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610abe2-6ced-4d12-a325-5534154e107d admin admin] RBAC: Authorizing `identity:create_grant(project_id=927855ba1a9845569ad811b5137117e2, user_id=fcae1b10d99d46d4ba0fe62d091d6ef4, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:14.682199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610abe2-6ced-4d12-a325-5534154e107d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:14.711106 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1243/2456] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:10:14 2022] PUT /identity/v3/projects/927855ba1a9845569ad811b5137117e2/users/fcae1b10d99d46d4ba0fe62d091d6ef4/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:10:23.265660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4774e0-c6b6-44ee-a4ac-ed247991cfd5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:23.267787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5f4774e0-c6b6-44ee-a4ac-ed247991cfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:23.323046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cce9cd-294b-41a9-9ef5-a0b37770cf68 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:23.323888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cce9cd-294b-41a9-9ef5-a0b37770cf68 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:23.323888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cce9cd-294b-41a9-9ef5-a0b37770cf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:23.340407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:23.372818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-e2cce9cd-294b-41a9-9ef5-a0b37770cf68 None None] MFA Rules not processed for user `fcae1b10d99d46d4ba0fe62d091d6ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:23.374289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e2cce9cd-294b-41a9-9ef5-a0b37770cf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:23.429775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4774e0-c6b6-44ee-a4ac-ed247991cfd5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:23.586420 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992be4ab-aa2b-4138-9e68-38a1aded494b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:23.587093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be4ab-aa2b-4138-9e68-38a1aded494b service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:23.587567 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be4ab-aa2b-4138-9e68-38a1aded494b service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:23.587853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992be4ab-aa2b-4138-9e68-38a1aded494b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:23.590065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-992be4ab-aa2b-4138-9e68-38a1aded494b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:23.591797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1244/2457] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:23.606695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cce9cd-294b-41a9-9ef5-a0b37770cf68 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:23.613329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e2cce9cd-294b-41a9-9ef5-a0b37770cf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:23.689282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992be4ab-aa2b-4138-9e68-38a1aded494b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:23.690807 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992be4ab-aa2b-4138-9e68-38a1aded494b service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:23.705341 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1214/2458] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:10:23.809996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cce9cd-294b-41a9-9ef5-a0b37770cf68 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:23.821642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ac10b-d7c1-47b6-9e25-5b5278948f98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:23.822832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac10b-d7c1-47b6-9e25-5b5278948f98 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:23.823125 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac10b-d7c1-47b6-9e25-5b5278948f98 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:23.823410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac10b-d7c1-47b6-9e25-5b5278948f98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:23.914986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ac10b-d7c1-47b6-9e25-5b5278948f98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:23.916812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ac10b-d7c1-47b6-9e25-5b5278948f98 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:23.929878 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1245/2459] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:10:25.286288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a868-48a8-45b1-b0df-68d756b7d71b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:25.287810 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a868-48a8-45b1-b0df-68d756b7d71b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:25.288294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97a868-48a8-45b1-b0df-68d756b7d71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:25.305238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:25.309345 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-cc97a868-48a8-45b1-b0df-68d756b7d71b None None] MFA Rules not processed for user `58b97e802e4c4e73933e34507e44aea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:25.311242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-cc97a868-48a8-45b1-b0df-68d756b7d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:25.324498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1215/2460] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:26.642589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ac10b-d7c1-47b6-9e25-5b5278948f98 service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:26.644399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b00ac10b-d7c1-47b6-9e25-5b5278948f98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:26.664782 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:26.795054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ac10b-d7c1-47b6-9e25-5b5278948f98 service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:26.800453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:26.801626 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:26.802293 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:26.802967 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] PATH_INFO: `/v3/users/113aa91c5988412a835a3ae399bf3e16` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:26.804662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] RBAC: Authorizing `identity:delete_user(user_id=113aa91c5988412a835a3ae399bf3e16)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:26.807219 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:26.876021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113aa91c5988412a835a3ae399bf3e16'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:26.893233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113aa91c5988412a835a3ae399bf3e16'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:26.894566 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113aa91c5988412a835a3ae399bf3e16'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:26.899100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113aa91c5988412a835a3ae399bf3e16'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:26.920716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113aa91c5988412a835a3ae399bf3e16'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:26.950910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1246/2461] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:10:26 2022] DELETE /identity/v3/users/113aa91c5988412a835a3ae399bf3e16 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:10:26.955382 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e769a7-cf0e-4b94-8672-07b2aafc5ad7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:26.956210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e769a7-cf0e-4b94-8672-07b2aafc5ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:26.956667 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e769a7-cf0e-4b94-8672-07b2aafc5ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:26.990649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a5e769a7-cf0e-4b94-8672-07b2aafc5ad7 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:27.001174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a5e769a7-cf0e-4b94-8672-07b2aafc5ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:27.138405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1216/2462] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:27.145616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:27.147644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:27.251589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2926e2-b9fa-4731-9c84-36523c21372f admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:27.256154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c84ca-76ee-4e74-9eb8-dcf97c1dbc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:27.256865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c84ca-76ee-4e74-9eb8-dcf97c1dbc51 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:27.257153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c84ca-76ee-4e74-9eb8-dcf97c1dbc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:27.257434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c84ca-76ee-4e74-9eb8-dcf97c1dbc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:27.275971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c84ca-76ee-4e74-9eb8-dcf97c1dbc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:27.277516 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c84ca-76ee-4e74-9eb8-dcf97c1dbc51 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:27.291569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1247/2463] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:10:27.719528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e769a7-cf0e-4b94-8672-07b2aafc5ad7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:27.721043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a5e769a7-cf0e-4b94-8672-07b2aafc5ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:27.741732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e769a7-cf0e-4b94-8672-07b2aafc5ad7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:27.750538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:27.751755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:27.752094 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:27.753487 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] PATH_INFO: `/v3/projects/0e6ffbcd90f749bfb935dcb1be3cb48d` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:27.755034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6ffbcd90f749bfb935dcb1be3cb48d)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:27.758187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:27.852834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6ffbcd90f749bfb935dcb1be3cb48d', 'request_id': 'req-73219af3-3efc-4ff3-b06d-ee58fae63dda'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:27.859827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6ffbcd90f749bfb935dcb1be3cb48d', 'request_id': 'req-73219af3-3efc-4ff3-b06d-ee58fae63dda'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:27.871454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6ffbcd90f749bfb935dcb1be3cb48d', 'request_id': 'req-73219af3-3efc-4ff3-b06d-ee58fae63dda'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:27.887366 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] The token cache is being invalidate because project 0e6ffbcd90f749bfb935dcb1be3cb48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:10:27.887991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:27.888889 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:27.891168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1217/2464] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:10:27 2022] DELETE /identity/v3/projects/0e6ffbcd90f749bfb935dcb1be3cb48d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:10:35.062168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b59456-d871-428a-b974-7ffcc80ca3c4 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:35.062672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b59456-d871-428a-b974-7ffcc80ca3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:35.062672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b59456-d871-428a-b974-7ffcc80ca3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:35.114184 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:35.117884 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-42b59456-d871-428a-b974-7ffcc80ca3c4 None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:35.119598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-42b59456-d871-428a-b974-7ffcc80ca3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:35.194743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1248/2465] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 20 06:10:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:35.208101 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:35.210267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:35.345188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73219af3-3efc-4ff3-b06d-ee58fae63dda admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:35.350771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e4ad7-6546-42cf-bbf4-69d92501e791 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:35.351586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e4ad7-6546-42cf-bbf4-69d92501e791 service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:35.351873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e4ad7-6546-42cf-bbf4-69d92501e791 service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:35.352151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e4ad7-6546-42cf-bbf4-69d92501e791 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:35.357535 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:35.361990 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e4ad7-6546-42cf-bbf4-69d92501e791 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:35.363619 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e4ad7-6546-42cf-bbf4-69d92501e791 service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:35.384539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1218/2466] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:10:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:10:43.800458 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b59456-d871-428a-b974-7ffcc80ca3c4 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:43.802247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-42b59456-d871-428a-b974-7ffcc80ca3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:43.909715 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b59456-d871-428a-b974-7ffcc80ca3c4 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:43.916259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74df3-9a6b-4e29-8a7f-48c3ebe01e2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e0b53aafc4bf3a23a7882ed12a89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:43.916983 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74df3-9a6b-4e29-8a7f-48c3ebe01e2e service placement] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:43.917275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74df3-9a6b-4e29-8a7f-48c3ebe01e2e service placement] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:43.918204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74df3-9a6b-4e29-8a7f-48c3ebe01e2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:43.920303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d3f74df3-9a6b-4e29-8a7f-48c3ebe01e2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:43.934026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f74df3-9a6b-4e29-8a7f-48c3ebe01e2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:43.936194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f74df3-9a6b-4e29-8a7f-48c3ebe01e2e service placement] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:43.948235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1249/2467] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:10:45.385472 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:45.706563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9f81-97b9-4b5d-975a-75ee93083300 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:45.707146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9f81-97b9-4b5d-975a-75ee93083300 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:45.707637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9f81-97b9-4b5d-975a-75ee93083300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:45.729298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b93e9f81-97b9-4b5d-975a-75ee93083300 None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:45.730875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b93e9f81-97b9-4b5d-975a-75ee93083300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:45.746293 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1219/2468] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:10:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:45.755094 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74df3-9a6b-4e29-8a7f-48c3ebe01e2e service placement] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:45.768685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74df3-9a6b-4e29-8a7f-48c3ebe01e2e service placement] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:45.774682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b833d-c56e-40ee-992e-22e19f65d829 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:45.775396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b833d-c56e-40ee-992e-22e19f65d829 service swift] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:45.775678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b833d-c56e-40ee-992e-22e19f65d829 service swift] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:45.775954 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b833d-c56e-40ee-992e-22e19f65d829 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:45.785550 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b833d-c56e-40ee-992e-22e19f65d829 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:45.787155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b833d-c56e-40ee-992e-22e19f65d829 service swift] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:45.796347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1250/2469] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:10:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:10:46.562805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876c50-732f-4bd7-8d67-57bb49c6104e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:46.563703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876c50-732f-4bd7-8d67-57bb49c6104e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:46.564393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc876c50-732f-4bd7-8d67-57bb49c6104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:46.609782 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-dc876c50-732f-4bd7-8d67-57bb49c6104e None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:46.612908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dc876c50-732f-4bd7-8d67-57bb49c6104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:46.627226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1220/2470] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 20 06:10:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:46.645366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b833d-c56e-40ee-992e-22e19f65d829 service swift] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:46.658032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b833d-c56e-40ee-992e-22e19f65d829 service swift] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:46.667486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2849e32-2520-403c-a4d7-4241f9c87a37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:46.668688 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2849e32-2520-403c-a4d7-4241f9c87a37 service swift] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:46.669144 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2849e32-2520-403c-a4d7-4241f9c87a37 service swift] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:46.669694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2849e32-2520-403c-a4d7-4241f9c87a37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:46.679705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2849e32-2520-403c-a4d7-4241f9c87a37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:46.681872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2849e32-2520-403c-a4d7-4241f9c87a37 service swift] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:46.693310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1251/2471] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:10:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:10:46.964700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a51ad8-75e6-4be6-a3b4-cbce9f86365a None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:46.964991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a51ad8-75e6-4be6-a3b4-cbce9f86365a None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:46.965279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a51ad8-75e6-4be6-a3b4-cbce9f86365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:46.988756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e6a51ad8-75e6-4be6-a3b4-cbce9f86365a None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:46.989970 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e6a51ad8-75e6-4be6-a3b4-cbce9f86365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:47.010612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2849e32-2520-403c-a4d7-4241f9c87a37 service swift] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:47.019976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1221/2472] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:10:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:47.025366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2849e32-2520-403c-a4d7-4241f9c87a37 service swift] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:47.033181 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404eb51-ee16-4eef-8126-1836979f0204 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:47.034711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404eb51-ee16-4eef-8126-1836979f0204 service swift] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:47.035061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404eb51-ee16-4eef-8126-1836979f0204 service swift] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:47.035409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404eb51-ee16-4eef-8126-1836979f0204 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:47.046801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404eb51-ee16-4eef-8126-1836979f0204 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:47.051397 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404eb51-ee16-4eef-8126-1836979f0204 service swift] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:47.061173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1252/2473] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:10:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:10:47.479680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920d3d7-0824-40f1-b34a-cef520626135 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:47.480159 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920d3d7-0824-40f1-b34a-cef520626135 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:47.480679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920d3d7-0824-40f1-b34a-cef520626135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:47.502555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-9920d3d7-0824-40f1-b34a-cef520626135 None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:47.504107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9920d3d7-0824-40f1-b34a-cef520626135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:47.520989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1222/2474] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 20 06:10:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:47.535167 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404eb51-ee16-4eef-8126-1836979f0204 service swift] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:47.548128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404eb51-ee16-4eef-8126-1836979f0204 service swift] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:47.553316 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660de31-e72a-4aae-8d43-ca91a6cdebd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:47.554528 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660de31-e72a-4aae-8d43-ca91a6cdebd7 service swift] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:47.554824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660de31-e72a-4aae-8d43-ca91a6cdebd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:47.555726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660de31-e72a-4aae-8d43-ca91a6cdebd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:47.565862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660de31-e72a-4aae-8d43-ca91a6cdebd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:47.567569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660de31-e72a-4aae-8d43-ca91a6cdebd7 service swift] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:47.577484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1253/2475] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:10:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:10:49.797869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920d3d7-0824-40f1-b34a-cef520626135 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:49.799482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9920d3d7-0824-40f1-b34a-cef520626135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:49.868576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920d3d7-0824-40f1-b34a-cef520626135 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:49.873435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:49.874315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:49.874629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:49.874868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] PATH_INFO: `/v3/users/93bfd48d2e0a4a1d815a377657c50d35` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:49.876191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93bfd48d2e0a4a1d815a377657c50d35)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:49.878150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:49.925971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93bfd48d2e0a4a1d815a377657c50d35'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:49.926664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93bfd48d2e0a4a1d815a377657c50d35'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:49.933824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93bfd48d2e0a4a1d815a377657c50d35'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:49.941171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93bfd48d2e0a4a1d815a377657c50d35'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:49.941792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93bfd48d2e0a4a1d815a377657c50d35'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:49.959712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1223/2476] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:10:49 2022] DELETE /identity/v3/users/93bfd48d2e0a4a1d815a377657c50d35 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:10:49.965243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7067d-3bc0-4f1e-8fab-165ad11fcb15 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:49.965754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7067d-3bc0-4f1e-8fab-165ad11fcb15 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:49.965848 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7067d-3bc0-4f1e-8fab-165ad11fcb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:49.989635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-cdc7067d-3bc0-4f1e-8fab-165ad11fcb15 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:49.990838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-cdc7067d-3bc0-4f1e-8fab-165ad11fcb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:50.003422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:50.049654 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1254/2477] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:10:50.059059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:50.060492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:50.116258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a7886-c373-48b5-a2fe-8a5e6f74b783 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:50.119966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be0c81-22f5-445a-9757-ef4797beb2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:50.120631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be0c81-22f5-445a-9757-ef4797beb2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:50.120918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be0c81-22f5-445a-9757-ef4797beb2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:50.121192 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be0c81-22f5-445a-9757-ef4797beb2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:50.128044 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:50.130734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be0c81-22f5-445a-9757-ef4797beb2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:50.132520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be0c81-22f5-445a-9757-ef4797beb2f2 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:50.144258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1224/2478] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:10:50.312227 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7067d-3bc0-4f1e-8fab-165ad11fcb15 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:50.313681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-cdc7067d-3bc0-4f1e-8fab-165ad11fcb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:50.326158 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7067d-3bc0-4f1e-8fab-165ad11fcb15 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:50.330788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:50.331650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:50.331940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:50.332241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] PATH_INFO: `/v3/projects/50357e34e2294f7ab3f80593e286e0e3` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:50.333457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50357e34e2294f7ab3f80593e286e0e3)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:50.335380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:50.381470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50357e34e2294f7ab3f80593e286e0e3', 'request_id': 'req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:50.387834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50357e34e2294f7ab3f80593e286e0e3', 'request_id': 'req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:50.394253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50357e34e2294f7ab3f80593e286e0e3', 'request_id': 'req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:50.406460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] The token cache is being invalidate because project 50357e34e2294f7ab3f80593e286e0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:10:50.406717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:50.407360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:10:50.408939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1255/2479] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:10:50 2022] DELETE /identity/v3/projects/50357e34e2294f7ab3f80593e286e0e3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:10:55.731243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a0de-e1e4-4937-873c-990183a9a641 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:55.731797 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a0de-e1e4-4937-873c-990183a9a641 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:55.731797 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a0de-e1e4-4937-873c-990183a9a641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:55.749569 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b601a0de-e1e4-4937-873c-990183a9a641 None None] MFA Rules not processed for user `c2b89a9466d848529893af51e99be1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:10:55.750779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b601a0de-e1e4-4937-873c-990183a9a641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:55.805793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1225/2480] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:10:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:10:57.829242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:10:57.830831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:57.887117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c98336-9c4f-4d62-ad79-3f3b8f926cd9 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:10:57.890725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe5c0d-6bc3-4632-9f38-c0e36e5249ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:10:57.891367 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe5c0d-6bc3-4632-9f38-c0e36e5249ab service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:10:57.891651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe5c0d-6bc3-4632-9f38-c0e36e5249ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:10:57.891930 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe5c0d-6bc3-4632-9f38-c0e36e5249ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:10:57.893696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0ffe5c0d-6bc3-4632-9f38-c0e36e5249ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:10:57.953259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:10:57.958189 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe5c0d-6bc3-4632-9f38-c0e36e5249ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:10:57.960056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe5c0d-6bc3-4632-9f38-c0e36e5249ab service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:10:57.972061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1256/2481] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:10:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:11:05.798627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=27 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:07.968289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:28.209018 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c25d11-c35f-4479-9b94-a19b3c0402ec None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:28.209595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c25d11-c35f-4479-9b94-a19b3c0402ec None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:28.209595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c25d11-c35f-4479-9b94-a19b3c0402ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:28.227362 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-03c25d11-c35f-4479-9b94-a19b3c0402ec None None] MFA Rules not processed for user `6bad8a4de2c84319a8601e7625c2655e`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:28.228631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-03c25d11-c35f-4479-9b94-a19b3c0402ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.294364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1226/2482] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:11:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:28.901880 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda2662-c109-4249-8f36-0f7f4ef31d2f None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:11:28.902441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda2662-c109-4249-8f36-0f7f4ef31d2f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:11:28.902441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda2662-c109-4249-8f36-0f7f4ef31d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:11:28.919400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-7cda2662-c109-4249-8f36-0f7f4ef31d2f None None] MFA Rules not processed for user `57b64cdf97214cddb23851747cb051d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:11:28.920636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7cda2662-c109-4249-8f36-0f7f4ef31d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:11:28.985980 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1257/2483] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:11:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:11:38.279029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=25 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:38.978003 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=25 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:08.795580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fdc9b-3f7e-4636-98ac-e150226a0dab None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:08.796116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fdc9b-3f7e-4636-98ac-e150226a0dab None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:08.796116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fdc9b-3f7e-4636-98ac-e150226a0dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:08.814112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-262fdc9b-3f7e-4636-98ac-e150226a0dab None None] MFA Rules not processed for user `c2b89a9466d848529893af51e99be1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:08.815312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-262fdc9b-3f7e-4636-98ac-e150226a0dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:08.823066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1227/2484] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:12:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:13.081756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda2662-c109-4249-8f36-0f7f4ef31d2f None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:13.083182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7cda2662-c109-4249-8f36-0f7f4ef31d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:13.246953 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda2662-c109-4249-8f36-0f7f4ef31d2f None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:13.250994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d4d9c-6b94-4474-8375-a7b4b7f93858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:13.251849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d4d9c-6b94-4474-8375-a7b4b7f93858 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:13.253139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d4d9c-6b94-4474-8375-a7b4b7f93858 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:13.253582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d4d9c-6b94-4474-8375-a7b4b7f93858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:13.255957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5c8d4d9c-6b94-4474-8375-a7b4b7f93858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:13.351192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d4d9c-6b94-4474-8375-a7b4b7f93858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:13.352746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d4d9c-6b94-4474-8375-a7b4b7f93858 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:13.364925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1258/2485] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:14.886098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fdc9b-3f7e-4636-98ac-e150226a0dab None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:14.895832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fdc9b-3f7e-4636-98ac-e150226a0dab None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:14.899995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e80a36-5ebf-4e6d-9f45-8d2114148b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:14.900672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e80a36-5ebf-4e6d-9f45-8d2114148b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:14.900936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e80a36-5ebf-4e6d-9f45-8d2114148b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:14.901212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e80a36-5ebf-4e6d-9f45-8d2114148b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:14.902956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b9e80a36-5ebf-4e6d-9f45-8d2114148b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:14.915851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e80a36-5ebf-4e6d-9f45-8d2114148b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:14.917360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e80a36-5ebf-4e6d-9f45-8d2114148b18 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:14.927986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1228/2486] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:23.360232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=63 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:24.533447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b48ab7-804b-4acb-b94a-94deda412ac5 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:24.534098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b48ab7-804b-4acb-b94a-94deda412ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:24.534098 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b48ab7-804b-4acb-b94a-94deda412ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:24.554469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c4b48ab7-804b-4acb-b94a-94deda412ac5 None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:24.555680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c4b48ab7-804b-4acb-b94a-94deda412ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:24.634954 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1259/2487] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 20 06:12:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:12:24.685565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e80a36-5ebf-4e6d-9f45-8d2114148b18 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:24.687478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b9e80a36-5ebf-4e6d-9f45-8d2114148b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:24.762980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e80a36-5ebf-4e6d-9f45-8d2114148b18 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:24.768413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0aabac-0462-453a-b3fa-e81ea609e3ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:24.769085 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aabac-0462-453a-b3fa-e81ea609e3ff service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:24.769369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aabac-0462-453a-b3fa-e81ea609e3ff service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:24.769644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0aabac-0462-453a-b3fa-e81ea609e3ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:24.778737 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0aabac-0462-453a-b3fa-e81ea609e3ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:24.780332 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0aabac-0462-453a-b3fa-e81ea609e3ff service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:24.789367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1229/2488] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:12:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:12:25.706135 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b48ab7-804b-4acb-b94a-94deda412ac5 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:25.707785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c4b48ab7-804b-4acb-b94a-94deda412ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:25.724079 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b48ab7-804b-4acb-b94a-94deda412ac5 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:25.730389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52bfbd-7fd7-49ed-9650-60901ec2f92d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:25.731040 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52bfbd-7fd7-49ed-9650-60901ec2f92d service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:25.731330 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52bfbd-7fd7-49ed-9650-60901ec2f92d service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:25.731614 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52bfbd-7fd7-49ed-9650-60901ec2f92d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:25.733470 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-be52bfbd-7fd7-49ed-9650-60901ec2f92d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:25.744834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52bfbd-7fd7-49ed-9650-60901ec2f92d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:25.746440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52bfbd-7fd7-49ed-9650-60901ec2f92d service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:25.758116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1260/2489] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:31.938947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0aabac-0462-453a-b3fa-e81ea609e3ff service swift] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:31.951698 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0aabac-0462-453a-b3fa-e81ea609e3ff service swift] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:31.958835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d03185-e179-4164-8b07-107a8ba0bec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:31.960292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d03185-e179-4164-8b07-107a8ba0bec8 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:31.960795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d03185-e179-4164-8b07-107a8ba0bec8 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:31.961235 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d03185-e179-4164-8b07-107a8ba0bec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:31.963768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d2d03185-e179-4164-8b07-107a8ba0bec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:31.976583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d03185-e179-4164-8b07-107a8ba0bec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:31.978553 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d03185-e179-4164-8b07-107a8ba0bec8 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:31.989048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1230/2490] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:33.288097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52bfbd-7fd7-49ed-9650-60901ec2f92d service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.290159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-be52bfbd-7fd7-49ed-9650-60901ec2f92d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:33.408663 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52bfbd-7fd7-49ed-9650-60901ec2f92d service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.416759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.418005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.418380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.418753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] PATH_INFO: `/v3/users/0883c5f7ca2f4f49b99e85350b5ca526` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.420156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0883c5f7ca2f4f49b99e85350b5ca526)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.423396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.481872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0883c5f7ca2f4f49b99e85350b5ca526'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.489487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0883c5f7ca2f4f49b99e85350b5ca526'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.490222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0883c5f7ca2f4f49b99e85350b5ca526'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.490872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0883c5f7ca2f4f49b99e85350b5ca526'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.505010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0883c5f7ca2f4f49b99e85350b5ca526'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.519172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1261/2491] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:33 2022] DELETE /identity/v3/users/0883c5f7ca2f4f49b99e85350b5ca526 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:33.707315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d03185-e179-4164-8b07-107a8ba0bec8 service nova] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.731714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d03185-e179-4164-8b07-107a8ba0bec8 service nova] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.794255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.795110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.795391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.795790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] PATH_INFO: `/v3/projects/146149e6b11e447cbefaba99dc6c4f15` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.797202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] RBAC: Authorizing `identity:delete_project(project_id=146149e6b11e447cbefaba99dc6c4f15)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.799007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:33.854212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '146149e6b11e447cbefaba99dc6c4f15', 'request_id': 'req-be8d242e-e74c-4653-bf6c-b2f3cb67122b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.859934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '146149e6b11e447cbefaba99dc6c4f15', 'request_id': 'req-be8d242e-e74c-4653-bf6c-b2f3cb67122b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.861620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:33.870128 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '146149e6b11e447cbefaba99dc6c4f15', 'request_id': 'req-be8d242e-e74c-4653-bf6c-b2f3cb67122b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.882471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] The token cache is being invalidate because project 146149e6b11e447cbefaba99dc6c4f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:33.882764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.883407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:33.884988 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1231/2492] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:33 2022] DELETE /identity/v3/projects/146149e6b11e447cbefaba99dc6c4f15 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:33.888850 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:33.890253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:33.903409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fb520-f0af-4569-9912-d75c9c618cd6 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:33.911030 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:33.961027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:33.961897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:33.962203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:33.962476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] PATH_INFO: `/v3/users/af12629dee2d4dda92d4b317468f155b` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:33.963646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af12629dee2d4dda92d4b317468f155b)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:33.965596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.011975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af12629dee2d4dda92d4b317468f155b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:34.018969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af12629dee2d4dda92d4b317468f155b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:34.019646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af12629dee2d4dda92d4b317468f155b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:34.020253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af12629dee2d4dda92d4b317468f155b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:34.034442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af12629dee2d4dda92d4b317468f155b'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:34.046837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1262/2493] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:33 2022] DELETE /identity/v3/users/af12629dee2d4dda92d4b317468f155b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:34.220261 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:34.221757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:34.238262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d242e-e74c-4653-bf6c-b2f3cb67122b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:34.300453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:34.301233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:34.301507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:34.301779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] PATH_INFO: `/v3/projects/07c640b00c4341259670bbe22bcdf0c8` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:34.303557 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c640b00c4341259670bbe22bcdf0c8)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:34.305495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:34.350822 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c640b00c4341259670bbe22bcdf0c8', 'request_id': 'req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:34.356388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c640b00c4341259670bbe22bcdf0c8', 'request_id': 'req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:34.363516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c640b00c4341259670bbe22bcdf0c8', 'request_id': 'req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:34.375219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] The token cache is being invalidate because project 07c640b00c4341259670bbe22bcdf0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:34.375564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:34.376251 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:34.377805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1232/2494] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:34 2022] DELETE /identity/v3/projects/07c640b00c4341259670bbe22bcdf0c8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:38.699916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:38.701417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:38.761422 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bb11c-067a-48ae-8983-462ff983d722 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:38.806175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:38.813074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed106-b751-4cea-a249-922643179b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:38.813749 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed106-b751-4cea-a249-922643179b2c service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:38.814212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed106-b751-4cea-a249-922643179b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:38.814849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed106-b751-4cea-a249-922643179b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:38.817427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c8bed106-b751-4cea-a249-922643179b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:38.878811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bed106-b751-4cea-a249-922643179b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:38.880261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bed106-b751-4cea-a249-922643179b2c service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:38.890368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1263/2495] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:42.033809 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:42.035270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:42.050152 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e82bff-dd0f-4a3b-a202-d30d0acee0f5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:42.055189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fa5b7-b8a5-4565-90a8-8b13d67b5e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:42.056146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fa5b7-b8a5-4565-90a8-8b13d67b5e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:42.056478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fa5b7-b8a5-4565-90a8-8b13d67b5e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:42.056832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fa5b7-b8a5-4565-90a8-8b13d67b5e8b admin admin] PATH_INFO: `/v3/users/57b64cdf97214cddb23851747cb051d4` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:42.058129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fa5b7-b8a5-4565-90a8-8b13d67b5e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b64cdf97214cddb23851747cb051d4)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:42.060102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fa5b7-b8a5-4565-90a8-8b13d67b5e8b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:42.110225 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d67fa5b7-b8a5-4565-90a8-8b13d67b5e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b64cdf97214cddb23851747cb051d4'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:42.111032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d67fa5b7-b8a5-4565-90a8-8b13d67b5e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b64cdf97214cddb23851747cb051d4'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:42.118112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d67fa5b7-b8a5-4565-90a8-8b13d67b5e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b64cdf97214cddb23851747cb051d4'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:42.125102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d67fa5b7-b8a5-4565-90a8-8b13d67b5e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b64cdf97214cddb23851747cb051d4'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:42.125716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d67fa5b7-b8a5-4565-90a8-8b13d67b5e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b64cdf97214cddb23851747cb051d4'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:42.132622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:42.145039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1233/2496] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:12:42 2022] DELETE /identity/v3/users/57b64cdf97214cddb23851747cb051d4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:42.331153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed106-b751-4cea-a249-922643179b2c service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:42.353336 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed106-b751-4cea-a249-922643179b2c service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:42.414318 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:42.415175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:42.415454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:42.415755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] PATH_INFO: `/v3/projects/2e86727ed46d4b9d9297f9586930023a` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:42.416947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e86727ed46d4b9d9297f9586930023a)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:42.418848 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:42.463495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e86727ed46d4b9d9297f9586930023a', 'request_id': 'req-becdcdbc-1eda-4917-892d-e9b1677aee12'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:42.468903 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e86727ed46d4b9d9297f9586930023a', 'request_id': 'req-becdcdbc-1eda-4917-892d-e9b1677aee12'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:42.474891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e86727ed46d4b9d9297f9586930023a', 'request_id': 'req-becdcdbc-1eda-4917-892d-e9b1677aee12'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:42.487083 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] The token cache is being invalidate because project 2e86727ed46d4b9d9297f9586930023a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:12:42.487371 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:42.487985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-becdcdbc-1eda-4917-892d-e9b1677aee12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:12:42.489515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1264/2497] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:12:42 2022] DELETE /identity/v3/projects/2e86727ed46d4b9d9297f9586930023a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:42.494498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3e225-d754-42f0-9be4-61bfe489f659 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:42.494791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3e225-d754-42f0-9be4-61bfe489f659 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:42.495069 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3e225-d754-42f0-9be4-61bfe489f659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:42.513674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e0b3e225-d754-42f0-9be4-61bfe489f659 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:42.514948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e0b3e225-d754-42f0-9be4-61bfe489f659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:42.592083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1234/2498] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:42.599604 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc2643-57d4-45b9-8b2f-6cd059048e6b None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:42.599898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc2643-57d4-45b9-8b2f-6cd059048e6b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:42.600182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc2643-57d4-45b9-8b2f-6cd059048e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:42.618234 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-5dfc2643-57d4-45b9-8b2f-6cd059048e6b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:42.619428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5dfc2643-57d4-45b9-8b2f-6cd059048e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:42.627284 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1265/2499] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:42.631950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3e225-d754-42f0-9be4-61bfe489f659 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:42.647385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3e225-d754-42f0-9be4-61bfe489f659 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:42.652191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d22f-a2d3-4b9e-ba5a-60eb5ffaec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:42.653339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d22f-a2d3-4b9e-ba5a-60eb5ffaec04 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:42.653635 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d22f-a2d3-4b9e-ba5a-60eb5ffaec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:42.653913 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761d22f-a2d3-4b9e-ba5a-60eb5ffaec04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:42.654645 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d22f-a2d3-4b9e-ba5a-60eb5ffaec04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:12:42.654958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d22f-a2d3-4b9e-ba5a-60eb5ffaec04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:42.656599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761d22f-a2d3-4b9e-ba5a-60eb5ffaec04 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:42.668084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1235/2500] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:12:42.672407 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc2643-57d4-45b9-8b2f-6cd059048e6b None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:42.681638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc2643-57d4-45b9-8b2f-6cd059048e6b None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:42.686302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a86280-269a-4c35-bef6-ff1d5a38fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:42.686941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a86280-269a-4c35-bef6-ff1d5a38fbef admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:42.687228 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a86280-269a-4c35-bef6-ff1d5a38fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:42.687507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a86280-269a-4c35-bef6-ff1d5a38fbef admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:42.688198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a86280-269a-4c35-bef6-ff1d5a38fbef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:42.690130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a86280-269a-4c35-bef6-ff1d5a38fbef admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:42.710263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:42.718685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1266/2501] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:12:42 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:42.722549 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d22f-a2d3-4b9e-ba5a-60eb5ffaec04 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:42.732563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761d22f-a2d3-4b9e-ba5a-60eb5ffaec04 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:42.789561 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ee0c-5f67-4ace-97f3-bc18c557cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:42.790210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ee0c-5f67-4ace-97f3-bc18c557cdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:42.790491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ee0c-5f67-4ace-97f3-bc18c557cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:42.790764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ee0c-5f67-4ace-97f3-bc18c557cdf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:42.791449 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2ee0c-5f67-4ace-97f3-bc18c557cdf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:42.793395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2ee0c-5f67-4ace-97f3-bc18c557cdf7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:42.815811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1236/2502] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:12:42 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:12:42.817049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a86280-269a-4c35-bef6-ff1d5a38fbef admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:42.827182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a86280-269a-4c35-bef6-ff1d5a38fbef admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:42.831711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9bcbb-72df-4566-b1d2-a8e0a62f9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:42.832456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9bcbb-72df-4566-b1d2-a8e0a62f9142 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:42.832741 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9bcbb-72df-4566-b1d2-a8e0a62f9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:42.833018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9bcbb-72df-4566-b1d2-a8e0a62f9142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:42.834265 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9bcbb-72df-4566-b1d2-a8e0a62f9142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:42.835865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9bcbb-72df-4566-b1d2-a8e0a62f9142 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:42.845972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1267/2503] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:42.850304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ee0c-5f67-4ace-97f3-bc18c557cdf7 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:42.860148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ee0c-5f67-4ace-97f3-bc18c557cdf7 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:42.864867 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257e5b5-a0aa-4c81-93d6-925db94b58ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:42.865536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257e5b5-a0aa-4c81-93d6-925db94b58ea admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:42.865816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257e5b5-a0aa-4c81-93d6-925db94b58ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:42.866091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257e5b5-a0aa-4c81-93d6-925db94b58ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:42.866808 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257e5b5-a0aa-4c81-93d6-925db94b58ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:42.868440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257e5b5-a0aa-4c81-93d6-925db94b58ea admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:42.878200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1237/2504] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:12:42.882185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9bcbb-72df-4566-b1d2-a8e0a62f9142 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:42.893300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9bcbb-72df-4566-b1d2-a8e0a62f9142 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:42.898743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91363a-d3c7-4c7b-b01f-729ed5abc503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:42.900478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91363a-d3c7-4c7b-b01f-729ed5abc503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:42.900764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91363a-d3c7-4c7b-b01f-729ed5abc503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:42.901049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91363a-d3c7-4c7b-b01f-729ed5abc503 admin admin] PATH_INFO: `/v3/projects/f024feca646b4e70b75034339a7920d8/users/e5604b0b261f477898ef2d5b9cc0dfea/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:42.918469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91363a-d3c7-4c7b-b01f-729ed5abc503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f024feca646b4e70b75034339a7920d8, user_id=e5604b0b261f477898ef2d5b9cc0dfea, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:42.921173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91363a-d3c7-4c7b-b01f-729ed5abc503 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:42.934869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1268/2505] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:12:42 2022] PUT /identity/v3/projects/f024feca646b4e70b75034339a7920d8/users/e5604b0b261f477898ef2d5b9cc0dfea/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:12:42.939614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa977f-a981-467e-b1f0-98803de7136f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:42.939921 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa977f-a981-467e-b1f0-98803de7136f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:42.940198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa977f-a981-467e-b1f0-98803de7136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:42.957654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4baa977f-a981-467e-b1f0-98803de7136f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:42.959382 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4baa977f-a981-467e-b1f0-98803de7136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:43.009945 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:43.023689 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1238/2506] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:43.033248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91363a-d3c7-4c7b-b01f-729ed5abc503 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:43.034982 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-fa91363a-d3c7-4c7b-b01f-729ed5abc503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:43.091164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91363a-d3c7-4c7b-b01f-729ed5abc503 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:43.094824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550410a-4403-4544-9cf2-1e65840d2097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:43.095461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550410a-4403-4544-9cf2-1e65840d2097 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:43.095739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550410a-4403-4544-9cf2-1e65840d2097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:43.096061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550410a-4403-4544-9cf2-1e65840d2097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:43.105497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550410a-4403-4544-9cf2-1e65840d2097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:43.106929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550410a-4403-4544-9cf2-1e65840d2097 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:43.116934 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1269/2507] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:46.998366 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e2c92-7249-461d-8d8f-7457e36290ac None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:46.998898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e2c92-7249-461d-8d8f-7457e36290ac None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:46.999125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e2c92-7249-461d-8d8f-7457e36290ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:47.032853 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7c5e2c92-7249-461d-8d8f-7457e36290ac None None] MFA Rules not processed for user `e5604b0b261f477898ef2d5b9cc0dfea`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:47.034612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7c5e2c92-7249-461d-8d8f-7457e36290ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:47.126872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1239/2508] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:12:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:47.136238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550410a-4403-4544-9cf2-1e65840d2097 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:47.137226 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e550410a-4403-4544-9cf2-1e65840d2097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:47.250777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550410a-4403-4544-9cf2-1e65840d2097 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:47.258829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b4bf8-35e1-4676-a073-43cb14bec63b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:47.259500 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b4bf8-35e1-4676-a073-43cb14bec63b service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:47.259793 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b4bf8-35e1-4676-a073-43cb14bec63b service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:47.260073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b4bf8-35e1-4676-a073-43cb14bec63b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:47.278040 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b4bf8-35e1-4676-a073-43cb14bec63b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:47.279698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b4bf8-35e1-4676-a073-43cb14bec63b service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:47.289790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1270/2509] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:48.743592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b783-3291-49ba-b02a-27dfc23771e7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:48.744064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b783-3291-49ba-b02a-27dfc23771e7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:48.744180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b783-3291-49ba-b02a-27dfc23771e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:48.762530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e009b783-3291-49ba-b02a-27dfc23771e7 None None] MFA Rules not processed for user `e5604b0b261f477898ef2d5b9cc0dfea`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:48.763752 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e009b783-3291-49ba-b02a-27dfc23771e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:48.771574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1240/2510] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:12:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:49.147702 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14696106-f8e2-4136-b383-d71df6c4336e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:49.148742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14696106-f8e2-4136-b383-d71df6c4336e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:49.149033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14696106-f8e2-4136-b383-d71df6c4336e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:49.149694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009b783-3291-49ba-b02a-27dfc23771e7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:49.151360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e009b783-3291-49ba-b02a-27dfc23771e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:49.165111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009b783-3291-49ba-b02a-27dfc23771e7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:49.169422 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6cf35-2e0a-4ca8-9c2a-81b8a3e74a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:49.170078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6cf35-2e0a-4ca8-9c2a-81b8a3e74a22 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:49.170357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6cf35-2e0a-4ca8-9c2a-81b8a3e74a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:49.170629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6cf35-2e0a-4ca8-9c2a-81b8a3e74a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:49.173032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e8c6cf35-2e0a-4ca8-9c2a-81b8a3e74a22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:49.177959 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-14696106-f8e2-4136-b383-d71df6c4336e None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:12:49.179155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-14696106-f8e2-4136-b383-d71df6c4336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:49.191063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6cf35-2e0a-4ca8-9c2a-81b8a3e74a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:49.193888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6cf35-2e0a-4ca8-9c2a-81b8a3e74a22 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:49.209498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1241/2511] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:49.253030 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:49.266894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1271/2512] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:12:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:12:49.282120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6cf35-2e0a-4ca8-9c2a-81b8a3e74a22 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:49.283637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e8c6cf35-2e0a-4ca8-9c2a-81b8a3e74a22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:49.370444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6cf35-2e0a-4ca8-9c2a-81b8a3e74a22 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:49.377060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b2cf8-359b-4175-a35f-509caef15be3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:49.377720 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b2cf8-359b-4175-a35f-509caef15be3 service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:49.378004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b2cf8-359b-4175-a35f-509caef15be3 service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:49.378408 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b2cf8-359b-4175-a35f-509caef15be3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:49.393625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b2cf8-359b-4175-a35f-509caef15be3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:49.395330 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b2cf8-359b-4175-a35f-509caef15be3 service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:49.425441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1242/2513] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:12:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:12:49.648563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14696106-f8e2-4136-b383-d71df6c4336e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:49.650205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-14696106-f8e2-4136-b383-d71df6c4336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:49.743612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14696106-f8e2-4136-b383-d71df6c4336e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:49.750136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980744ee-a7cd-4e2a-87f4-63cf6ed22bc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e0b53aafc4bf3a23a7882ed12a89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:49.750902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980744ee-a7cd-4e2a-87f4-63cf6ed22bc9 service placement] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:49.751305 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980744ee-a7cd-4e2a-87f4-63cf6ed22bc9 service placement] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:49.759298 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980744ee-a7cd-4e2a-87f4-63cf6ed22bc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:49.768432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-980744ee-a7cd-4e2a-87f4-63cf6ed22bc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:49.781787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980744ee-a7cd-4e2a-87f4-63cf6ed22bc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:49.783399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980744ee-a7cd-4e2a-87f4-63cf6ed22bc9 service placement] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:49.808757 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1272/2514] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:52.375097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b2cf8-359b-4175-a35f-509caef15be3 service swift] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:12:52.386637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b2cf8-359b-4175-a35f-509caef15be3 service swift] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:12:52.391205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11505efd-069b-40bc-b320-f8ccfe2be1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:12:52.392193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11505efd-069b-40bc-b320-f8ccfe2be1bc service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:12:52.393130 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11505efd-069b-40bc-b320-f8ccfe2be1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:12:52.393607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11505efd-069b-40bc-b320-f8ccfe2be1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:12:52.395649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-11505efd-069b-40bc-b320-f8ccfe2be1bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:12:52.408205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11505efd-069b-40bc-b320-f8ccfe2be1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:12:52.410077 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11505efd-069b-40bc-b320-f8ccfe2be1bc service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:12:52.420351 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1243/2515] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:12:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:12:59.789485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=34 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:02.416448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=81 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:03.295869 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980744ee-a7cd-4e2a-87f4-63cf6ed22bc9 service placement] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:03.297644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-980744ee-a7cd-4e2a-87f4-63cf6ed22bc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:03.314642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980744ee-a7cd-4e2a-87f4-63cf6ed22bc9 service placement] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:03.323475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7768418-2df9-4d3d-9bac-827129557980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:03.325673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768418-2df9-4d3d-9bac-827129557980 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:03.326205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768418-2df9-4d3d-9bac-827129557980 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:03.326907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7768418-2df9-4d3d-9bac-827129557980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:03.330382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b7768418-2df9-4d3d-9bac-827129557980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:03.350057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7768418-2df9-4d3d-9bac-827129557980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:03.353017 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7768418-2df9-4d3d-9bac-827129557980 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:03.380655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1273/2516] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:03.424953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11505efd-069b-40bc-b320-f8ccfe2be1bc service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:03.440290 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11505efd-069b-40bc-b320-f8ccfe2be1bc service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:03.446524 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c70b74-bca5-4e59-899e-437cbd87aff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:03.447252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c70b74-bca5-4e59-899e-437cbd87aff2 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:03.447952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c70b74-bca5-4e59-899e-437cbd87aff2 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:03.447952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c70b74-bca5-4e59-899e-437cbd87aff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:03.449654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a6c70b74-bca5-4e59-899e-437cbd87aff2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:03.465031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c70b74-bca5-4e59-899e-437cbd87aff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:03.466630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c70b74-bca5-4e59-899e-437cbd87aff2 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:03.477872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1244/2517] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:05.523666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7768418-2df9-4d3d-9bac-827129557980 service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:05.532983 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7768418-2df9-4d3d-9bac-827129557980 service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:05.537788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d508fb-5b00-4146-b3ec-88e991bb97b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:05.538373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d508fb-5b00-4146-b3ec-88e991bb97b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.538651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d508fb-5b00-4146-b3ec-88e991bb97b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.538929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d508fb-5b00-4146-b3ec-88e991bb97b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.540788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d8d508fb-5b00-4146-b3ec-88e991bb97b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:05.550780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d508fb-5b00-4146-b3ec-88e991bb97b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:05.552245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d508fb-5b00-4146-b3ec-88e991bb97b5 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:05.560081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1274/2518] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:05.661100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46786-5bed-4996-96cb-cff4daaf5fe4 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.661653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46786-5bed-4996-96cb-cff4daaf5fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.661653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d46786-5bed-4996-96cb-cff4daaf5fe4 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.663014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1245/2519] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:13:05.668613 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14832cd-0b7e-40d2-97cb-3cd38c74a6bb None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.668952 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14832cd-0b7e-40d2-97cb-3cd38c74a6bb None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.669229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14832cd-0b7e-40d2-97cb-3cd38c74a6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.706685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-f14832cd-0b7e-40d2-97cb-3cd38c74a6bb None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:05.708545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f14832cd-0b7e-40d2-97cb-3cd38c74a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:05.718001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1275/2520] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:13:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:05.730024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d46786-5bed-4996-96cb-cff4daaf5fe4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:05.731848 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-28d46786-5bed-4996-96cb-cff4daaf5fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:05.816258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d46786-5bed-4996-96cb-cff4daaf5fe4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:05.820334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555f913-a49e-4466-971b-d96c524b31a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f36041751a446885608f5a3b1f37df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:05.820975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555f913-a49e-4466-971b-d96c524b31a5 service glance] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.821257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555f913-a49e-4466-971b-d96c524b31a5 service glance] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.821533 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555f913-a49e-4466-971b-d96c524b31a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.831584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555f913-a49e-4466-971b-d96c524b31a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:05.833738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555f913-a49e-4466-971b-d96c524b31a5 service glance] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:05.844184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1246/2521] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:05.908294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d86f3-8f09-4167-8f15-1315604ecd1a None None] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.908610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d86f3-8f09-4167-8f15-1315604ecd1a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.908890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d86f3-8f09-4167-8f15-1315604ecd1a None None] PATH_INFO: `/` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.910298 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1276/2522] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:13:05.915518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a0c14-8567-4fe9-8c5f-4b81ae7ab249 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.915836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a0c14-8567-4fe9-8c5f-4b81ae7ab249 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.916113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a0c14-8567-4fe9-8c5f-4b81ae7ab249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.935043 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-697a0c14-8567-4fe9-8c5f-4b81ae7ab249 None None] MFA Rules not processed for user `70b46194590c47c08c8d9d98904a2d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:05.936243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-697a0c14-8567-4fe9-8c5f-4b81ae7ab249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:05.942765 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1247/2523] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:13:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:05.953978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d86f3-8f09-4167-8f15-1315604ecd1a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:05.965246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d86f3-8f09-4167-8f15-1315604ecd1a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:05.968732 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dd4a9-008b-41ba-8c6f-a45a1c897b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:05.969352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dd4a9-008b-41ba-8c6f-a45a1c897b97 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:05.969635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dd4a9-008b-41ba-8c6f-a45a1c897b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:05.969909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dd4a9-008b-41ba-8c6f-a45a1c897b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:05.977523 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dd4a9-008b-41ba-8c6f-a45a1c897b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:05.978967 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dd4a9-008b-41ba-8c6f-a45a1c897b97 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:05.986943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1277/2524] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:06.066100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3dfc1-eb50-4b3d-8a81-68ac0285db21 None None] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:06.066471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3dfc1-eb50-4b3d-8a81-68ac0285db21 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:06.066703 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3dfc1-eb50-4b3d-8a81-68ac0285db21 None None] PATH_INFO: `/` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:06.068179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1248/2525] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jun 20 06:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 06:13:06.072914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1e5e-e421-47bc-9c95-415fdeb03383 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:06.073208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1e5e-e421-47bc-9c95-415fdeb03383 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:06.073492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1e5e-e421-47bc-9c95-415fdeb03383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:06.091874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-ae5e1e5e-e421-47bc-9c95-415fdeb03383 None None] MFA Rules not processed for user `cbe8aea409c3459f9f7b3c3ef6ff583b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:06.093119 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ae5e1e5e-e421-47bc-9c95-415fdeb03383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:06.102968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1278/2526] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jun 20 06:13:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:06.113066 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3dfc1-eb50-4b3d-8a81-68ac0285db21 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:06.123985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3dfc1-eb50-4b3d-8a81-68ac0285db21 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:06.127576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e4ca0-689c-4504-855c-5028fee35831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:06.128206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e4ca0-689c-4504-855c-5028fee35831 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:06.128517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e4ca0-689c-4504-855c-5028fee35831 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:06.128794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e4ca0-689c-4504-855c-5028fee35831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:06.139115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e4ca0-689c-4504-855c-5028fee35831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:06.140566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e4ca0-689c-4504-855c-5028fee35831 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:06.151829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1249/2527] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:07.976800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f8ee-8b21-4050-88d5-4654a9376ee6 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:07.977252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f8ee-8b21-4050-88d5-4654a9376ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:07.977558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f8ee-8b21-4050-88d5-4654a9376ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:07.995436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-a249f8ee-8b21-4050-88d5-4654a9376ee6 None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:07.996766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a249f8ee-8b21-4050-88d5-4654a9376ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:08.003941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1279/2528] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jun 20 06:13:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:08.016506 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e4ca0-689c-4504-855c-5028fee35831 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:08.028994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e4ca0-689c-4504-855c-5028fee35831 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:08.034105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dc8b9-694f-4de0-9777-ae9627b67881 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:08.034746 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dc8b9-694f-4de0-9777-ae9627b67881 service swift] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:08.035027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dc8b9-694f-4de0-9777-ae9627b67881 service swift] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:08.035306 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dc8b9-694f-4de0-9777-ae9627b67881 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:08.043770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dc8b9-694f-4de0-9777-ae9627b67881 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:08.045380 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361dc8b9-694f-4de0-9777-ae9627b67881 service swift] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:08.053537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1250/2529] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:13:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:13:08.921529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249f8ee-8b21-4050-88d5-4654a9376ee6 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:08.938833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249f8ee-8b21-4050-88d5-4654a9376ee6 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:08.945021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fe41d-c57a-46d0-90cc-c44c746e0885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:08.945670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fe41d-c57a-46d0-90cc-c44c746e0885 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:08.946074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fe41d-c57a-46d0-90cc-c44c746e0885 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:08.946360 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fe41d-c57a-46d0-90cc-c44c746e0885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:08.948188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-6b9fe41d-c57a-46d0-90cc-c44c746e0885 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:09.016302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fe41d-c57a-46d0-90cc-c44c746e0885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:09.018173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fe41d-c57a-46d0-90cc-c44c746e0885 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:09.028117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1280/2530] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:18.050214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=56 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:19.023467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=61 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:23.941234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8efcd-879f-422d-849b-fc47707d6565 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:23.941781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8efcd-879f-422d-849b-fc47707d6565 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:23.941781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8efcd-879f-422d-849b-fc47707d6565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:23.962103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3bc8efcd-879f-422d-849b-fc47707d6565 None None] MFA Rules not processed for user `25a82cc64a424e3d87062043f24d5285`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:23.963387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3bc8efcd-879f-422d-849b-fc47707d6565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:23.970696 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1251/2531] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jun 20 06:13:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:23.983501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fe41d-c57a-46d0-90cc-c44c746e0885 service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:23.995499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fe41d-c57a-46d0-90cc-c44c746e0885 service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:24.001348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45cd9f-2cc9-46be-bdae-6ca2116d43fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '265894b988a640f0b17846d4986b670a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:24.002071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cd9f-2cc9-46be-bdae-6ca2116d43fd service swift] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:24.002429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cd9f-2cc9-46be-bdae-6ca2116d43fd service swift] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:24.002781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cd9f-2cc9-46be-bdae-6ca2116d43fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:24.011694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45cd9f-2cc9-46be-bdae-6ca2116d43fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:24.013412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45cd9f-2cc9-46be-bdae-6ca2116d43fd service swift] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:24.022529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1281/2532] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jun 20 06:13:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 06:13:27.828123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8efcd-879f-422d-849b-fc47707d6565 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:27.841287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8efcd-879f-422d-849b-fc47707d6565 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:27.847112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c192844-6663-41eb-9e5c-f110af20bf24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:27.847786 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c192844-6663-41eb-9e5c-f110af20bf24 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:27.848067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c192844-6663-41eb-9e5c-f110af20bf24 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:27.848364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c192844-6663-41eb-9e5c-f110af20bf24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:27.850145 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1c192844-6663-41eb-9e5c-f110af20bf24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:27.864887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c192844-6663-41eb-9e5c-f110af20bf24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:27.866559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c192844-6663-41eb-9e5c-f110af20bf24 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:27.877852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1252/2533] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:33.876154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45cd9f-2cc9-46be-bdae-6ca2116d43fd service swift] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:33.886097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45cd9f-2cc9-46be-bdae-6ca2116d43fd service swift] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:33.889706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76d812-4514-46eb-a815-714b52933e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:33.890342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76d812-4514-46eb-a815-714b52933e7e service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:33.890626 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76d812-4514-46eb-a815-714b52933e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:33.890902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76d812-4514-46eb-a815-714b52933e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:33.892985 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0f76d812-4514-46eb-a815-714b52933e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:33.904938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76d812-4514-46eb-a815-714b52933e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:33.906373 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76d812-4514-46eb-a815-714b52933e7e service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:33.916105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1282/2534] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:36.752086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c192844-6663-41eb-9e5c-f110af20bf24 service nova] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:36.764901 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c192844-6663-41eb-9e5c-f110af20bf24 service nova] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:36.770821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7abcfb-f7ab-4aaa-95bf-c98bb9d73b19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e0b53aafc4bf3a23a7882ed12a89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:36.771574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7abcfb-f7ab-4aaa-95bf-c98bb9d73b19 service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:36.771868 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7abcfb-f7ab-4aaa-95bf-c98bb9d73b19 service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:36.772194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7abcfb-f7ab-4aaa-95bf-c98bb9d73b19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:36.774224 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fa7abcfb-f7ab-4aaa-95bf-c98bb9d73b19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:36.787617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7abcfb-f7ab-4aaa-95bf-c98bb9d73b19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:36.789197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7abcfb-f7ab-4aaa-95bf-c98bb9d73b19 service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:36.801723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1253/2535] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:36.820745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76d812-4514-46eb-a815-714b52933e7e service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:36.823294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-0f76d812-4514-46eb-a815-714b52933e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:36.839463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76d812-4514-46eb-a815-714b52933e7e service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:36.842391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded6cb9-4a02-4420-a41f-b122c17112c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:36.843255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6cb9-4a02-4420-a41f-b122c17112c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:36.843543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6cb9-4a02-4420-a41f-b122c17112c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:36.844020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded6cb9-4a02-4420-a41f-b122c17112c9 admin admin] PATH_INFO: `/v3/users/c2b89a9466d848529893af51e99be1a8` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:36.845264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded6cb9-4a02-4420-a41f-b122c17112c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b89a9466d848529893af51e99be1a8)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:36.847256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded6cb9-4a02-4420-a41f-b122c17112c9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:36.893685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1ded6cb9-4a02-4420-a41f-b122c17112c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b89a9466d848529893af51e99be1a8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:36.900568 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1ded6cb9-4a02-4420-a41f-b122c17112c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b89a9466d848529893af51e99be1a8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:36.901237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1ded6cb9-4a02-4420-a41f-b122c17112c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b89a9466d848529893af51e99be1a8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:36.901841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1ded6cb9-4a02-4420-a41f-b122c17112c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b89a9466d848529893af51e99be1a8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:36.913585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1ded6cb9-4a02-4420-a41f-b122c17112c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b89a9466d848529893af51e99be1a8'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:36.928628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1283/2536] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:36 2022] DELETE /identity/v3/users/c2b89a9466d848529893af51e99be1a8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:37.104506 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7abcfb-f7ab-4aaa-95bf-c98bb9d73b19 service placement] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:37.116055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7abcfb-f7ab-4aaa-95bf-c98bb9d73b19 service placement] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:37.180539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:37.181399 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.181699 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.181974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] PATH_INFO: `/v3/projects/916417cb906e4f35a3b7fd9f5f52bd16` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.183142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916417cb906e4f35a3b7fd9f5f52bd16)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:37.185084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:37.228678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916417cb906e4f35a3b7fd9f5f52bd16', 'request_id': 'req-c6cb9482-cc8c-4599-89ac-f749257abd37'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:37.234078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916417cb906e4f35a3b7fd9f5f52bd16', 'request_id': 'req-c6cb9482-cc8c-4599-89ac-f749257abd37'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:37.241899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916417cb906e4f35a3b7fd9f5f52bd16', 'request_id': 'req-c6cb9482-cc8c-4599-89ac-f749257abd37'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:37.253628 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] The token cache is being invalidate because project 916417cb906e4f35a3b7fd9f5f52bd16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:37.253628 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:37.254300 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c6cb9482-cc8c-4599-89ac-f749257abd37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:37.255870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1254/2537] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:37 2022] DELETE /identity/v3/projects/916417cb906e4f35a3b7fd9f5f52bd16 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:37.260756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149701-87c9-44c7-983b-342dd8835f90 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.261060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149701-87c9-44c7-983b-342dd8835f90 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.261348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71149701-87c9-44c7-983b-342dd8835f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.279413 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-71149701-87c9-44c7-983b-342dd8835f90 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:37.280608 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-71149701-87c9-44c7-983b-342dd8835f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:37.339760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1284/2538] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:37.347973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823fad8-a450-49ea-9f1d-88843be77334 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.348260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823fad8-a450-49ea-9f1d-88843be77334 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.348582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823fad8-a450-49ea-9f1d-88843be77334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.367794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a823fad8-a450-49ea-9f1d-88843be77334 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:37.369024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a823fad8-a450-49ea-9f1d-88843be77334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:37.377086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1255/2539] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:37.381768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71149701-87c9-44c7-983b-342dd8835f90 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:37.391529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71149701-87c9-44c7-983b-342dd8835f90 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:37.396929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c3db4-10cf-4276-a771-ccd177e830ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:37.397574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c3db4-10cf-4276-a771-ccd177e830ea admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.397861 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c3db4-10cf-4276-a771-ccd177e830ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.398138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c3db4-10cf-4276-a771-ccd177e830ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.398865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c3db4-10cf-4276-a771-ccd177e830ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:37.399172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c3db4-10cf-4276-a771-ccd177e830ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:37.400811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c3db4-10cf-4276-a771-ccd177e830ea admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:37.412180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1285/2540] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:37.416571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823fad8-a450-49ea-9f1d-88843be77334 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:37.425621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823fad8-a450-49ea-9f1d-88843be77334 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:37.430249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28831ab-7a12-46ad-b14b-7f2a8a4ff5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:37.430880 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28831ab-7a12-46ad-b14b-7f2a8a4ff5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.431158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28831ab-7a12-46ad-b14b-7f2a8a4ff5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.431425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28831ab-7a12-46ad-b14b-7f2a8a4ff5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.432105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28831ab-7a12-46ad-b14b-7f2a8a4ff5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:37.434010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28831ab-7a12-46ad-b14b-7f2a8a4ff5f6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:37.468781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1256/2541] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:37 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:37.472984 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c3db4-10cf-4276-a771-ccd177e830ea admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:37.482743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c3db4-10cf-4276-a771-ccd177e830ea admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:37.512839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:37.540561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20713f12-65e1-40bc-a62f-e7f275638bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:37.541155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20713f12-65e1-40bc-a62f-e7f275638bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.541435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20713f12-65e1-40bc-a62f-e7f275638bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.541709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20713f12-65e1-40bc-a62f-e7f275638bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.542392 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20713f12-65e1-40bc-a62f-e7f275638bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:37.544296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20713f12-65e1-40bc-a62f-e7f275638bc6 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:37.565069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1286/2542] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:37 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:37.569677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28831ab-7a12-46ad-b14b-7f2a8a4ff5f6 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:37.579750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28831ab-7a12-46ad-b14b-7f2a8a4ff5f6 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:37.584502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a210d67-11b0-4680-8cea-bca3181f8ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:37.585147 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a210d67-11b0-4680-8cea-bca3181f8ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.585427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a210d67-11b0-4680-8cea-bca3181f8ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.585699 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a210d67-11b0-4680-8cea-bca3181f8ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.586406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a210d67-11b0-4680-8cea-bca3181f8ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:37.587991 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a210d67-11b0-4680-8cea-bca3181f8ddf admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:37.597647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1257/2543] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:37.601261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20713f12-65e1-40bc-a62f-e7f275638bc6 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:37.611506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20713f12-65e1-40bc-a62f-e7f275638bc6 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:37.616688 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ee86d-7c2f-4168-8ce2-ea951161e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:37.617328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ee86d-7c2f-4168-8ce2-ea951161e5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.617610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ee86d-7c2f-4168-8ce2-ea951161e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.617912 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ee86d-7c2f-4168-8ce2-ea951161e5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.618641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ee86d-7c2f-4168-8ce2-ea951161e5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:37.620382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ee86d-7c2f-4168-8ce2-ea951161e5f8 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:37.632154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1287/2544] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:37.636047 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a210d67-11b0-4680-8cea-bca3181f8ddf admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:37.646612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a210d67-11b0-4680-8cea-bca3181f8ddf admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:37.651321 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4c9b-7a59-42b9-a6fa-eb75d6be5ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:37.652184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4c9b-7a59-42b9-a6fa-eb75d6be5ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.652500 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4c9b-7a59-42b9-a6fa-eb75d6be5ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.652774 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4c9b-7a59-42b9-a6fa-eb75d6be5ea0 admin admin] PATH_INFO: `/v3/projects/17fe3b5c8338476ea5229e2d6c6244d4/users/b63fef70fae9408c9c4ee5daf22ea3cc/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.656207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:37.669008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e4c9b-7a59-42b9-a6fa-eb75d6be5ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17fe3b5c8338476ea5229e2d6c6244d4, user_id=b63fef70fae9408c9c4ee5daf22ea3cc, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:37.672065 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e4c9b-7a59-42b9-a6fa-eb75d6be5ea0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:37.686527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1258/2545] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:37 2022] PUT /identity/v3/projects/17fe3b5c8338476ea5229e2d6c6244d4/users/b63fef70fae9408c9c4ee5daf22ea3cc/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:37.697481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e45d-163d-45ce-b956-55545e6652aa None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.697774 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e45d-163d-45ce-b956-55545e6652aa None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.698088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e45d-163d-45ce-b956-55545e6652aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.724641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-dd95e45d-163d-45ce-b956-55545e6652aa None None] MFA Rules not processed for user `b63fef70fae9408c9c4ee5daf22ea3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:37.725831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-dd95e45d-163d-45ce-b956-55545e6652aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:37.787535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1288/2546] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:37.792033 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4c9b-7a59-42b9-a6fa-eb75d6be5ea0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:37.853369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4c9b-7a59-42b9-a6fa-eb75d6be5ea0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:37.858456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351778d-a943-4a35-9e01-971d059d403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:37.859121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351778d-a943-4a35-9e01-971d059d403d admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.859398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351778d-a943-4a35-9e01-971d059d403d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.859673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351778d-a943-4a35-9e01-971d059d403d admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.860398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351778d-a943-4a35-9e01-971d059d403d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:37.862292 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351778d-a943-4a35-9e01-971d059d403d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:37.887533 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1259/2547] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:37 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:37.891641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95e45d-163d-45ce-b956-55545e6652aa None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:37.903686 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95e45d-163d-45ce-b956-55545e6652aa None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:37.958433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32856811-9e1c-4cc3-8d9d-1c285e650228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:37.959089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32856811-9e1c-4cc3-8d9d-1c285e650228 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:37.959368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32856811-9e1c-4cc3-8d9d-1c285e650228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:37.959643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32856811-9e1c-4cc3-8d9d-1c285e650228 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:37.960345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32856811-9e1c-4cc3-8d9d-1c285e650228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:37.962254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32856811-9e1c-4cc3-8d9d-1c285e650228 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:37.981062 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1289/2548] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:37 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:37.985071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351778d-a943-4a35-9e01-971d059d403d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:37.995317 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351778d-a943-4a35-9e01-971d059d403d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:37.999899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dd235-875f-472f-b9f7-623ba0af0111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:38.000598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dd235-875f-472f-b9f7-623ba0af0111 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.000886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dd235-875f-472f-b9f7-623ba0af0111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.001164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112dd235-875f-472f-b9f7-623ba0af0111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.001888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dd235-875f-472f-b9f7-623ba0af0111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:38.004005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112dd235-875f-472f-b9f7-623ba0af0111 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:38.014432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1260/2549] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:13:38.018461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32856811-9e1c-4cc3-8d9d-1c285e650228 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:38.028842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32856811-9e1c-4cc3-8d9d-1c285e650228 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:38.033468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff48ba2-7662-40c4-83d7-8a38beb16463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:38.034336 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff48ba2-7662-40c4-83d7-8a38beb16463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.034617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff48ba2-7662-40c4-83d7-8a38beb16463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.034891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff48ba2-7662-40c4-83d7-8a38beb16463 admin admin] PATH_INFO: `/v3/projects/8f032a0b5cc84b6abd44dae081899e4f/users/c9fd5310b86048159688c989182210f3/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.049804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff48ba2-7662-40c4-83d7-8a38beb16463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f032a0b5cc84b6abd44dae081899e4f, user_id=c9fd5310b86048159688c989182210f3, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:38.052423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff48ba2-7662-40c4-83d7-8a38beb16463 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:38.066321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1290/2550] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:38 2022] PUT /identity/v3/projects/8f032a0b5cc84b6abd44dae081899e4f/users/c9fd5310b86048159688c989182210f3/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:38.070391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dd235-875f-472f-b9f7-623ba0af0111 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:38.080588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112dd235-875f-472f-b9f7-623ba0af0111 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:38.135790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c4cf9-6447-4b76-8d5a-1453a30ceab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:38.136484 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c4cf9-6447-4b76-8d5a-1453a30ceab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.136773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c4cf9-6447-4b76-8d5a-1453a30ceab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.137053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c4cf9-6447-4b76-8d5a-1453a30ceab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.137775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c4cf9-6447-4b76-8d5a-1453a30ceab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:38.139378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c4cf9-6447-4b76-8d5a-1453a30ceab2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:38.149270 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1261/2551] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:38.153477 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff48ba2-7662-40c4-83d7-8a38beb16463 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:38.163996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff48ba2-7662-40c4-83d7-8a38beb16463 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:38.168559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f831fb-c0fb-46d3-9004-ecac2914e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:38.169428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f831fb-c0fb-46d3-9004-ecac2914e776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.169711 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f831fb-c0fb-46d3-9004-ecac2914e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.169986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f831fb-c0fb-46d3-9004-ecac2914e776 admin admin] PATH_INFO: `/v3/projects/8f032a0b5cc84b6abd44dae081899e4f/users/c9fd5310b86048159688c989182210f3/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.171928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f831fb-c0fb-46d3-9004-ecac2914e776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f032a0b5cc84b6abd44dae081899e4f, user_id=c9fd5310b86048159688c989182210f3, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:38.174573 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f831fb-c0fb-46d3-9004-ecac2914e776 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:38.177350 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:38.187019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1291/2552] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:38 2022] PUT /identity/v3/projects/8f032a0b5cc84b6abd44dae081899e4f/users/c9fd5310b86048159688c989182210f3/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:38.196912 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b583-b422-4712-9812-4d171a320e7f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.197204 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b583-b422-4712-9812-4d171a320e7f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.197488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0b583-b422-4712-9812-4d171a320e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.224218 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-23d0b583-b422-4712-9812-4d171a320e7f None None] MFA Rules not processed for user `c9fd5310b86048159688c989182210f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:38.225463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-23d0b583-b422-4712-9812-4d171a320e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:38.268526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:38.295246 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1262/2553] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:38.306385 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f831fb-c0fb-46d3-9004-ecac2914e776 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:38.308118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c9f831fb-c0fb-46d3-9004-ecac2914e776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:38.364537 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f831fb-c0fb-46d3-9004-ecac2914e776 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:38.368149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd078c3-b7b5-4b13-a53c-5cd1a29f35ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:38.368806 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd078c3-b7b5-4b13-a53c-5cd1a29f35ce service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.369089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd078c3-b7b5-4b13-a53c-5cd1a29f35ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.369364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd078c3-b7b5-4b13-a53c-5cd1a29f35ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.378246 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd078c3-b7b5-4b13-a53c-5cd1a29f35ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:38.379697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd078c3-b7b5-4b13-a53c-5cd1a29f35ce service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:38.389183 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1292/2554] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:38.757267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0b583-b422-4712-9812-4d171a320e7f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:38.819675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0b583-b422-4712-9812-4d171a320e7f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:38.824239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:38.825125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.825405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.825677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] PATH_INFO: `/v3/users/b63fef70fae9408c9c4ee5daf22ea3cc` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.826862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63fef70fae9408c9c4ee5daf22ea3cc)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:38.828829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:38.873200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63fef70fae9408c9c4ee5daf22ea3cc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.873847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63fef70fae9408c9c4ee5daf22ea3cc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.880581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63fef70fae9408c9c4ee5daf22ea3cc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.888456 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63fef70fae9408c9c4ee5daf22ea3cc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.889076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63fef70fae9408c9c4ee5daf22ea3cc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:38.906638 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1263/2555] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:38 2022] DELETE /identity/v3/users/b63fef70fae9408c9c4ee5daf22ea3cc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:38.911992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea2e8-90e8-454c-af79-5f59815fd12a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:38.912418 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea2e8-90e8-454c-af79-5f59815fd12a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:38.912652 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ea2e8-90e8-454c-af79-5f59815fd12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:38.930751 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-5c0ea2e8-90e8-454c-af79-5f59815fd12a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:38.931949 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5c0ea2e8-90e8-454c-af79-5f59815fd12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:38.989678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1293/2556] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:38.999173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.000619 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:39.062214 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8372836-272d-457e-97f1-be2aa73e85ff admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.066580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cbd70-30a2-4682-9e10-db4f3e8982a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.067295 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cbd70-30a2-4682-9e10-db4f3e8982a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.067605 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cbd70-30a2-4682-9e10-db4f3e8982a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.067879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1cbd70-30a2-4682-9e10-db4f3e8982a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.078344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cbd70-30a2-4682-9e10-db4f3e8982a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.079844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1cbd70-30a2-4682-9e10-db4f3e8982a3 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:39.089650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1264/2557] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:39.353130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ea2e8-90e8-454c-af79-5f59815fd12a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.354581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5c0ea2e8-90e8-454c-af79-5f59815fd12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:39.369962 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ea2e8-90e8-454c-af79-5f59815fd12a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.374801 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.375659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.375944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.376264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] PATH_INFO: `/v3/projects/17fe3b5c8338476ea5229e2d6c6244d4` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.377436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17fe3b5c8338476ea5229e2d6c6244d4)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.379813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:39.426225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17fe3b5c8338476ea5229e2d6c6244d4', 'request_id': 'req-065fbcda-eaff-45df-8461-bf9d1f53e346'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.431621 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17fe3b5c8338476ea5229e2d6c6244d4', 'request_id': 'req-065fbcda-eaff-45df-8461-bf9d1f53e346'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.437706 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17fe3b5c8338476ea5229e2d6c6244d4', 'request_id': 'req-065fbcda-eaff-45df-8461-bf9d1f53e346'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.458771 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] The token cache is being invalidate because project 17fe3b5c8338476ea5229e2d6c6244d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:39.459071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.459772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.464708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1294/2558] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:39 2022] DELETE /identity/v3/projects/17fe3b5c8338476ea5229e2d6c6244d4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:39.465919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cbd70-30a2-4682-9e10-db4f3e8982a3 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.470870 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:39.476140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1cbd70-30a2-4682-9e10-db4f3e8982a3 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.532851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49cf65-954b-425a-9163-3ca76b571e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.533744 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49cf65-954b-425a-9163-3ca76b571e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.534032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49cf65-954b-425a-9163-3ca76b571e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.534310 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49cf65-954b-425a-9163-3ca76b571e41 admin admin] PATH_INFO: `/v3/users/c9fd5310b86048159688c989182210f3` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.535544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49cf65-954b-425a-9163-3ca76b571e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fd5310b86048159688c989182210f3)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.537522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49cf65-954b-425a-9163-3ca76b571e41 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:39.583917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8a49cf65-954b-425a-9163-3ca76b571e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fd5310b86048159688c989182210f3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.584591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8a49cf65-954b-425a-9163-3ca76b571e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fd5310b86048159688c989182210f3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.591888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8a49cf65-954b-425a-9163-3ca76b571e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fd5310b86048159688c989182210f3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.599439 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8a49cf65-954b-425a-9163-3ca76b571e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fd5310b86048159688c989182210f3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.599989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-8a49cf65-954b-425a-9163-3ca76b571e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fd5310b86048159688c989182210f3'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:39.616660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1265/2559] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:39 2022] DELETE /identity/v3/users/c9fd5310b86048159688c989182210f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:39.888754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:39.890256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:39.906391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fbcda-eaff-45df-8461-bf9d1f53e346 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:39.929655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:39.970432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:39.971321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:39.971633 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:39.971960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] PATH_INFO: `/v3/projects/8f032a0b5cc84b6abd44dae081899e4f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:39.973304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f032a0b5cc84b6abd44dae081899e4f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:39.975497 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.020463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f032a0b5cc84b6abd44dae081899e4f', 'request_id': 'req-cef51a2e-b006-408c-9bc2-e112c3a956b7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:40.025738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f032a0b5cc84b6abd44dae081899e4f', 'request_id': 'req-cef51a2e-b006-408c-9bc2-e112c3a956b7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:40.031648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f032a0b5cc84b6abd44dae081899e4f', 'request_id': 'req-cef51a2e-b006-408c-9bc2-e112c3a956b7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:40.043740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] The token cache is being invalidate because project 8f032a0b5cc84b6abd44dae081899e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:40.044032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:40.044712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-cef51a2e-b006-408c-9bc2-e112c3a956b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:40.046288 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1295/2560] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:39 2022] DELETE /identity/v3/projects/8f032a0b5cc84b6abd44dae081899e4f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:40.052610 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32e2a5-4d1a-407a-91d4-e96f42fac613 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.053095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32e2a5-4d1a-407a-91d4-e96f42fac613 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.053195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32e2a5-4d1a-407a-91d4-e96f42fac613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.071287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fe32e2a5-4d1a-407a-91d4-e96f42fac613 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:40.072545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fe32e2a5-4d1a-407a-91d4-e96f42fac613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:40.132300 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1266/2561] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:40.141302 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331385-f607-4647-bcbe-6b28ac46776a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.141592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331385-f607-4647-bcbe-6b28ac46776a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.142124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331385-f607-4647-bcbe-6b28ac46776a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.160380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-cc331385-f607-4647-bcbe-6b28ac46776a None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:40.161573 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-cc331385-f607-4647-bcbe-6b28ac46776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:40.169333 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1296/2562] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:40.173630 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32e2a5-4d1a-407a-91d4-e96f42fac613 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.183732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32e2a5-4d1a-407a-91d4-e96f42fac613 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.188243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c8f1e-c3d1-4ab4-8be8-762e58af8ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.188923 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c8f1e-c3d1-4ab4-8be8-762e58af8ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.189207 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c8f1e-c3d1-4ab4-8be8-762e58af8ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.189480 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c8f1e-c3d1-4ab4-8be8-762e58af8ab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.190194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c8f1e-c3d1-4ab4-8be8-762e58af8ab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:40.190497 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c8f1e-c3d1-4ab4-8be8-762e58af8ab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.192106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c8f1e-c3d1-4ab4-8be8-762e58af8ab8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.203276 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1267/2563] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:40.207375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc331385-f607-4647-bcbe-6b28ac46776a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.216442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc331385-f607-4647-bcbe-6b28ac46776a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.221067 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8b1c0-c75e-4b0f-b548-9a1aee1c3625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.221701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8b1c0-c75e-4b0f-b548-9a1aee1c3625 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.222508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8b1c0-c75e-4b0f-b548-9a1aee1c3625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.222781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8b1c0-c75e-4b0f-b548-9a1aee1c3625 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.223471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8b1c0-c75e-4b0f-b548-9a1aee1c3625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.225385 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8b1c0-c75e-4b0f-b548-9a1aee1c3625 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.252297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1297/2564] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:40 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:40.256503 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c8f1e-c3d1-4ab4-8be8-762e58af8ab8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.266564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c8f1e-c3d1-4ab4-8be8-762e58af8ab8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.271406 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:40.323580 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f009-721a-44a9-9f23-e1296aa9132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.324242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f009-721a-44a9-9f23-e1296aa9132f admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.324563 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f009-721a-44a9-9f23-e1296aa9132f admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.324841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f009-721a-44a9-9f23-e1296aa9132f admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.325544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704f009-721a-44a9-9f23-e1296aa9132f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.327453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704f009-721a-44a9-9f23-e1296aa9132f admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.346384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1268/2565] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:40 2022] POST /identity/v3/users => generated 305 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:40.350887 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8b1c0-c75e-4b0f-b548-9a1aee1c3625 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.361112 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8b1c0-c75e-4b0f-b548-9a1aee1c3625 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.366325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e299c2-9bdd-499a-adc2-ef9f4cb0201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.366978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e299c2-9bdd-499a-adc2-ef9f4cb0201c admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.367267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e299c2-9bdd-499a-adc2-ef9f4cb0201c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.367545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e299c2-9bdd-499a-adc2-ef9f4cb0201c admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.368447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e299c2-9bdd-499a-adc2-ef9f4cb0201c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.370054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e299c2-9bdd-499a-adc2-ef9f4cb0201c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.381356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1298/2566] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:40.385327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f009-721a-44a9-9f23-e1296aa9132f admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.395469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f009-721a-44a9-9f23-e1296aa9132f admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.400395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56f6ad-8ac0-4d8b-b915-3a4e4ad5a25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.401046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56f6ad-8ac0-4d8b-b915-3a4e4ad5a25e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.401333 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56f6ad-8ac0-4d8b-b915-3a4e4ad5a25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.401618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56f6ad-8ac0-4d8b-b915-3a4e4ad5a25e admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.402369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56f6ad-8ac0-4d8b-b915-3a4e4ad5a25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.403960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56f6ad-8ac0-4d8b-b915-3a4e4ad5a25e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.414462 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1269/2567] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:13:40.418203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e299c2-9bdd-499a-adc2-ef9f4cb0201c admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.428543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e299c2-9bdd-499a-adc2-ef9f4cb0201c admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.433191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72492-b1f3-40bb-acf1-763cc191ac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.434054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72492-b1f3-40bb-acf1-763cc191ac37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.434341 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72492-b1f3-40bb-acf1-763cc191ac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.434617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb72492-b1f3-40bb-acf1-763cc191ac37 admin admin] PATH_INFO: `/v3/projects/8e4a6f085f3d4e2997a31c953a037a6c/users/f89a2f1fb1ee40eea615d928aa77ece9/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.448700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb72492-b1f3-40bb-acf1-763cc191ac37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4a6f085f3d4e2997a31c953a037a6c, user_id=f89a2f1fb1ee40eea615d928aa77ece9, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.451339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb72492-b1f3-40bb-acf1-763cc191ac37 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.464780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1299/2568] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:40 2022] PUT /identity/v3/projects/8e4a6f085f3d4e2997a31c953a037a6c/users/f89a2f1fb1ee40eea615d928aa77ece9/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:40.475415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc730f2-d982-4e85-8bd0-320f8771d66d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.475711 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc730f2-d982-4e85-8bd0-320f8771d66d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.475994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc730f2-d982-4e85-8bd0-320f8771d66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.502922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-6fc730f2-d982-4e85-8bd0-320f8771d66d None None] MFA Rules not processed for user `f89a2f1fb1ee40eea615d928aa77ece9`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:40.504145 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-6fc730f2-d982-4e85-8bd0-320f8771d66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:40.567604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1270/2569] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:40 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:40.572108 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72492-b1f3-40bb-acf1-763cc191ac37 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.618524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:40.634175 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb72492-b1f3-40bb-acf1-763cc191ac37 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.638929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2ab6e-466f-46f1-af65-efdee3af9ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.639507 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2ab6e-466f-46f1-af65-efdee3af9ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.639796 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2ab6e-466f-46f1-af65-efdee3af9ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.640081 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2ab6e-466f-46f1-af65-efdee3af9ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.640811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2ab6e-466f-46f1-af65-efdee3af9ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.642976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2ab6e-466f-46f1-af65-efdee3af9ee5 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.668071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1300/2570] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:40 2022] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:40.672074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc730f2-d982-4e85-8bd0-320f8771d66d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.683117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc730f2-d982-4e85-8bd0-320f8771d66d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.739343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5425829-a718-484d-b908-6ea9af21c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.740026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5425829-a718-484d-b908-6ea9af21c3cb admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.740344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5425829-a718-484d-b908-6ea9af21c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.740627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5425829-a718-484d-b908-6ea9af21c3cb admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.741314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5425829-a718-484d-b908-6ea9af21c3cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.743290 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5425829-a718-484d-b908-6ea9af21c3cb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.763344 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1271/2571] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:40 2022] POST /identity/v3/users => generated 311 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:40.766406 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2ab6e-466f-46f1-af65-efdee3af9ee5 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.777464 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2ab6e-466f-46f1-af65-efdee3af9ee5 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.782121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799c0e3-46ed-4803-a518-c5d6c95cc5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.782770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799c0e3-46ed-4803-a518-c5d6c95cc5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.783053 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799c0e3-46ed-4803-a518-c5d6c95cc5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.783329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799c0e3-46ed-4803-a518-c5d6c95cc5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.784061 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799c0e3-46ed-4803-a518-c5d6c95cc5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.786241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799c0e3-46ed-4803-a518-c5d6c95cc5e9 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.796842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1301/2572] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:40.800959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5425829-a718-484d-b908-6ea9af21c3cb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.810967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5425829-a718-484d-b908-6ea9af21c3cb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.816045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1446987-bcc5-4270-800a-5be40296230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.817118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446987-bcc5-4270-800a-5be40296230d admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.817405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446987-bcc5-4270-800a-5be40296230d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.817682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1446987-bcc5-4270-800a-5be40296230d admin admin] PATH_INFO: `/v3/projects/98bdfe14bc20417fbc400165ec428b9f/users/39cb6408d0404b4d960419e0bd155d89/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.819897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:40.834754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1446987-bcc5-4270-800a-5be40296230d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bdfe14bc20417fbc400165ec428b9f, user_id=39cb6408d0404b4d960419e0bd155d89, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.837486 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1446987-bcc5-4270-800a-5be40296230d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.850121 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1272/2573] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:40 2022] PUT /identity/v3/projects/98bdfe14bc20417fbc400165ec428b9f/users/39cb6408d0404b4d960419e0bd155d89/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:40.854046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799c0e3-46ed-4803-a518-c5d6c95cc5e9 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.863919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799c0e3-46ed-4803-a518-c5d6c95cc5e9 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.919136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74a071-f6e0-463f-913d-6527e03a95c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.919822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a071-f6e0-463f-913d-6527e03a95c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.920107 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a071-f6e0-463f-913d-6527e03a95c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.920410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74a071-f6e0-463f-913d-6527e03a95c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.921151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a071-f6e0-463f-913d-6527e03a95c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.922750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74a071-f6e0-463f-913d-6527e03a95c2 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.932916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1302/2574] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:40.937039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1446987-bcc5-4270-800a-5be40296230d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:40.947661 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1446987-bcc5-4270-800a-5be40296230d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:40.952250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512639f-d661-4907-b1a3-b59dc6445be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:40.953139 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512639f-d661-4907-b1a3-b59dc6445be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.953419 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512639f-d661-4907-b1a3-b59dc6445be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.953690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512639f-d661-4907-b1a3-b59dc6445be0 admin admin] PATH_INFO: `/v3/projects/98bdfe14bc20417fbc400165ec428b9f/users/39cb6408d0404b4d960419e0bd155d89/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:40.955626 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512639f-d661-4907-b1a3-b59dc6445be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bdfe14bc20417fbc400165ec428b9f, user_id=39cb6408d0404b4d960419e0bd155d89, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:40.958884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512639f-d661-4907-b1a3-b59dc6445be0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:40.969469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1273/2575] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:40 2022] PUT /identity/v3/projects/98bdfe14bc20417fbc400165ec428b9f/users/39cb6408d0404b4d960419e0bd155d89/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:40.980623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52713b-3288-48f9-a526-7a9fc2f32ea7 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:40.980918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52713b-3288-48f9-a526-7a9fc2f32ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:40.981201 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52713b-3288-48f9-a526-7a9fc2f32ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:41.007206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-3d52713b-3288-48f9-a526-7a9fc2f32ea7 None None] MFA Rules not processed for user `39cb6408d0404b4d960419e0bd155d89`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:41.008451 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3d52713b-3288-48f9-a526-7a9fc2f32ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:41.075399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1303/2576] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:41.086608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512639f-d661-4907-b1a3-b59dc6445be0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:41.088383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1512639f-d661-4907-b1a3-b59dc6445be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:41.144599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512639f-d661-4907-b1a3-b59dc6445be0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:41.148337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762b7d1-faac-44fb-8702-74279aaf8785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:41.148981 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762b7d1-faac-44fb-8702-74279aaf8785 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:41.149266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762b7d1-faac-44fb-8702-74279aaf8785 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:41.149542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762b7d1-faac-44fb-8702-74279aaf8785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:41.158694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762b7d1-faac-44fb-8702-74279aaf8785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:41.160174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762b7d1-faac-44fb-8702-74279aaf8785 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:41.169574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1274/2577] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:41.314186 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52713b-3288-48f9-a526-7a9fc2f32ea7 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:41.323636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52713b-3288-48f9-a526-7a9fc2f32ea7 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:41.327304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879fb3e-1e75-4092-b278-a5b94b6050c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:41.327944 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879fb3e-1e75-4092-b278-a5b94b6050c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:41.328228 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879fb3e-1e75-4092-b278-a5b94b6050c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:41.328530 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879fb3e-1e75-4092-b278-a5b94b6050c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:41.368299 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:41.385206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879fb3e-1e75-4092-b278-a5b94b6050c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:41.387066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879fb3e-1e75-4092-b278-a5b94b6050c1 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:41.396455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1304/2578] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:46.606583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762b7d1-faac-44fb-8702-74279aaf8785 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:46.672539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762b7d1-faac-44fb-8702-74279aaf8785 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:46.677825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:46.678675 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:46.678955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:46.679227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] PATH_INFO: `/v3/users/f89a2f1fb1ee40eea615d928aa77ece9` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:46.680417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f89a2f1fb1ee40eea615d928aa77ece9)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:46.682427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:46.730951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89a2f1fb1ee40eea615d928aa77ece9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:46.732081 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89a2f1fb1ee40eea615d928aa77ece9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:46.740478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89a2f1fb1ee40eea615d928aa77ece9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:46.749421 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89a2f1fb1ee40eea615d928aa77ece9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:46.750049 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89a2f1fb1ee40eea615d928aa77ece9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:46.757882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:46.769544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1275/2579] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:46 2022] DELETE /identity/v3/users/f89a2f1fb1ee40eea615d928aa77ece9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:46.774319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22d11b-b2ea-4ea6-87d9-d24b6e9d9dbe None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:46.774841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22d11b-b2ea-4ea6-87d9-d24b6e9d9dbe None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:46.774948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22d11b-b2ea-4ea6-87d9-d24b6e9d9dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:46.793025 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-4e22d11b-b2ea-4ea6-87d9-d24b6e9d9dbe None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:46.794289 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4e22d11b-b2ea-4ea6-87d9-d24b6e9d9dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:46.855147 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1305/2580] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:46.864823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:46.866337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:46.924267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0fd53-2c4d-4af7-9473-8c64e22a61ba admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:46.927898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396ebda-9105-430e-acef-8b52352e5c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:46.928568 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396ebda-9105-430e-acef-8b52352e5c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:46.928852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396ebda-9105-430e-acef-8b52352e5c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:46.929127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396ebda-9105-430e-acef-8b52352e5c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:46.938091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396ebda-9105-430e-acef-8b52352e5c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:46.939514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396ebda-9105-430e-acef-8b52352e5c32 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:46.949501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1276/2581] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:47.236727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22d11b-b2ea-4ea6-87d9-d24b6e9d9dbe None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:47.239054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-4e22d11b-b2ea-4ea6-87d9-d24b6e9d9dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:47.256808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22d11b-b2ea-4ea6-87d9-d24b6e9d9dbe None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:47.261586 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:47.262499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:47.262746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:47.263021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] PATH_INFO: `/v3/projects/8e4a6f085f3d4e2997a31c953a037a6c` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:47.264504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4a6f085f3d4e2997a31c953a037a6c)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:47.266501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:47.313696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4a6f085f3d4e2997a31c953a037a6c', 'request_id': 'req-d2da9067-acfc-4651-9e33-7ed4bc77121e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.320824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4a6f085f3d4e2997a31c953a037a6c', 'request_id': 'req-d2da9067-acfc-4651-9e33-7ed4bc77121e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.329940 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4a6f085f3d4e2997a31c953a037a6c', 'request_id': 'req-d2da9067-acfc-4651-9e33-7ed4bc77121e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.343641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] The token cache is being invalidate because project 8e4a6f085f3d4e2997a31c953a037a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:47.343931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.344656 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.346205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1306/2582] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:47 2022] DELETE /identity/v3/projects/8e4a6f085f3d4e2997a31c953a037a6c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:47.351610 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396ebda-9105-430e-acef-8b52352e5c32 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:47.361321 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396ebda-9105-430e-acef-8b52352e5c32 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:47.417023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79c5dd-f819-455c-8d76-f59d48756104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:47.417885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c5dd-f819-455c-8d76-f59d48756104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:47.418163 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c5dd-f819-455c-8d76-f59d48756104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:47.418436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c5dd-f819-455c-8d76-f59d48756104 admin admin] PATH_INFO: `/v3/users/39cb6408d0404b4d960419e0bd155d89` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:47.419603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79c5dd-f819-455c-8d76-f59d48756104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39cb6408d0404b4d960419e0bd155d89)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:47.421564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79c5dd-f819-455c-8d76-f59d48756104 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:47.467212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2b79c5dd-f819-455c-8d76-f59d48756104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39cb6408d0404b4d960419e0bd155d89'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.467800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2b79c5dd-f819-455c-8d76-f59d48756104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39cb6408d0404b4d960419e0bd155d89'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.474872 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2b79c5dd-f819-455c-8d76-f59d48756104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39cb6408d0404b4d960419e0bd155d89'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.481776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2b79c5dd-f819-455c-8d76-f59d48756104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39cb6408d0404b4d960419e0bd155d89'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.482591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2b79c5dd-f819-455c-8d76-f59d48756104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39cb6408d0404b4d960419e0bd155d89'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.502291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1277/2583] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:47 2022] DELETE /identity/v3/users/39cb6408d0404b4d960419e0bd155d89 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:47.780335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:47.782033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:47.796909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da9067-acfc-4651-9e33-7ed4bc77121e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:47.855338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:47.856204 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:47.856522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:47.856929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] PATH_INFO: `/v3/projects/98bdfe14bc20417fbc400165ec428b9f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:47.858003 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bdfe14bc20417fbc400165ec428b9f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:47.859960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:47.868740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:47.915058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bdfe14bc20417fbc400165ec428b9f', 'request_id': 'req-5d9fd5e4-394e-4bab-954e-8a442eca7133'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.920545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bdfe14bc20417fbc400165ec428b9f', 'request_id': 'req-5d9fd5e4-394e-4bab-954e-8a442eca7133'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.926664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bdfe14bc20417fbc400165ec428b9f', 'request_id': 'req-5d9fd5e4-394e-4bab-954e-8a442eca7133'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.939669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] The token cache is being invalidate because project 98bdfe14bc20417fbc400165ec428b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:47.939966 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.941153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d9fd5e4-394e-4bab-954e-8a442eca7133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:47.942842 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1307/2584] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:47 2022] DELETE /identity/v3/projects/98bdfe14bc20417fbc400165ec428b9f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:47.947844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3b3a8-8d57-434f-a2ca-2a30aa5c3a76 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:47.948389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3b3a8-8d57-434f-a2ca-2a30aa5c3a76 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:47.948491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3b3a8-8d57-434f-a2ca-2a30aa5c3a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:47.966286 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e2a3b3a8-8d57-434f-a2ca-2a30aa5c3a76 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:47.967664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e2a3b3a8-8d57-434f-a2ca-2a30aa5c3a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:47.979372 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:48.055372 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1278/2585] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:48.057678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e82f4-1262-403f-aac0-698c9a8cf005 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.058157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e82f4-1262-403f-aac0-698c9a8cf005 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.058384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e82f4-1262-403f-aac0-698c9a8cf005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.085527 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d08e82f4-1262-403f-aac0-698c9a8cf005 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:48.086947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d08e82f4-1262-403f-aac0-698c9a8cf005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:48.095829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1308/2586] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:13:48.100542 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3b3a8-8d57-434f-a2ca-2a30aa5c3a76 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.110999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3b3a8-8d57-434f-a2ca-2a30aa5c3a76 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.116570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb58124-ecba-4dee-b545-d111c83a10b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.117238 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb58124-ecba-4dee-b545-d111c83a10b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.117544 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb58124-ecba-4dee-b545-d111c83a10b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.117888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb58124-ecba-4dee-b545-d111c83a10b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.118798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb58124-ecba-4dee-b545-d111c83a10b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:48.118970 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb58124-ecba-4dee-b545-d111c83a10b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.122291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb58124-ecba-4dee-b545-d111c83a10b8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.133502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1279/2587] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:13:48.137679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e82f4-1262-403f-aac0-698c9a8cf005 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.148262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e82f4-1262-403f-aac0-698c9a8cf005 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.153032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821af7c9-3b69-4b26-bcc0-a300e1dbd7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.153676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821af7c9-3b69-4b26-bcc0-a300e1dbd7af admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.153955 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821af7c9-3b69-4b26-bcc0-a300e1dbd7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.154275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821af7c9-3b69-4b26-bcc0-a300e1dbd7af admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.154972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821af7c9-3b69-4b26-bcc0-a300e1dbd7af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.156886 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821af7c9-3b69-4b26-bcc0-a300e1dbd7af admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.184569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1309/2588] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:48 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:48.188062 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb58124-ecba-4dee-b545-d111c83a10b8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.199489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb58124-ecba-4dee-b545-d111c83a10b8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.256661 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990ffe5-0ac0-47df-a7f0-b8ea796c6ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.257333 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990ffe5-0ac0-47df-a7f0-b8ea796c6ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.257635 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990ffe5-0ac0-47df-a7f0-b8ea796c6ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.257894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990ffe5-0ac0-47df-a7f0-b8ea796c6ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.258579 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990ffe5-0ac0-47df-a7f0-b8ea796c6ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.260515 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990ffe5-0ac0-47df-a7f0-b8ea796c6ad6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.279887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1280/2589] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:48 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:48.283901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821af7c9-3b69-4b26-bcc0-a300e1dbd7af admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.294611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821af7c9-3b69-4b26-bcc0-a300e1dbd7af admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.299215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe02ff-15f8-4c9e-b6b3-5c38742ab266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.299908 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe02ff-15f8-4c9e-b6b3-5c38742ab266 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.300194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe02ff-15f8-4c9e-b6b3-5c38742ab266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.300508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe02ff-15f8-4c9e-b6b3-5c38742ab266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.301261 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe02ff-15f8-4c9e-b6b3-5c38742ab266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.302858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe02ff-15f8-4c9e-b6b3-5c38742ab266 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.313009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1310/2590] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:48.316942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990ffe5-0ac0-47df-a7f0-b8ea796c6ad6 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.326851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990ffe5-0ac0-47df-a7f0-b8ea796c6ad6 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.332004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07176f85-e1b2-41df-82c2-b432b0cf059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.332686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176f85-e1b2-41df-82c2-b432b0cf059e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.332969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176f85-e1b2-41df-82c2-b432b0cf059e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.333244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07176f85-e1b2-41df-82c2-b432b0cf059e admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.333965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07176f85-e1b2-41df-82c2-b432b0cf059e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.335570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07176f85-e1b2-41df-82c2-b432b0cf059e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.345334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1281/2591] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:48.349889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe02ff-15f8-4c9e-b6b3-5c38742ab266 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.359700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe02ff-15f8-4c9e-b6b3-5c38742ab266 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.364515 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4984d-88ba-45e1-a72a-fbf650d30a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.365386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4984d-88ba-45e1-a72a-fbf650d30a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.365712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4984d-88ba-45e1-a72a-fbf650d30a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.365947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4984d-88ba-45e1-a72a-fbf650d30a8e admin admin] PATH_INFO: `/v3/projects/f64d3f38ef03460cb2013165b31df921/users/dabfcf64c6614bb5a77f419b9e80759e/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.381142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4984d-88ba-45e1-a72a-fbf650d30a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64d3f38ef03460cb2013165b31df921, user_id=dabfcf64c6614bb5a77f419b9e80759e, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.383800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4984d-88ba-45e1-a72a-fbf650d30a8e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.398108 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1311/2592] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:48 2022] PUT /identity/v3/projects/f64d3f38ef03460cb2013165b31df921/users/dabfcf64c6614bb5a77f419b9e80759e/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:48.408513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a94fe-d6a4-4630-82ce-869e1556b2e2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.408830 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a94fe-d6a4-4630-82ce-869e1556b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.409167 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a94fe-d6a4-4630-82ce-869e1556b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.434700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-646a94fe-d6a4-4630-82ce-869e1556b2e2 None None] MFA Rules not processed for user `dabfcf64c6614bb5a77f419b9e80759e`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:48.435893 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-646a94fe-d6a4-4630-82ce-869e1556b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:48.503228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1282/2593] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:48.507581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4984d-88ba-45e1-a72a-fbf650d30a8e admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.569477 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4984d-88ba-45e1-a72a-fbf650d30a8e admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.574163 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e89e6-9a06-4fdf-8972-e57c27403313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.574861 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e89e6-9a06-4fdf-8972-e57c27403313 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.575144 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e89e6-9a06-4fdf-8972-e57c27403313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.575426 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e89e6-9a06-4fdf-8972-e57c27403313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.576122 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e89e6-9a06-4fdf-8972-e57c27403313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.578046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e89e6-9a06-4fdf-8972-e57c27403313 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.603133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1312/2594] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:48 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:48.607587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a94fe-d6a4-4630-82ce-869e1556b2e2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.618894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a94fe-d6a4-4630-82ce-869e1556b2e2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.623938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:48.675685 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ee19e-5891-4a26-8f5a-810d00ceba17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.676372 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee19e-5891-4a26-8f5a-810d00ceba17 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.676661 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee19e-5891-4a26-8f5a-810d00ceba17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.676937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee19e-5891-4a26-8f5a-810d00ceba17 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.677618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ee19e-5891-4a26-8f5a-810d00ceba17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.679537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ee19e-5891-4a26-8f5a-810d00ceba17 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.699279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1283/2595] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:48 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:48.703506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e89e6-9a06-4fdf-8972-e57c27403313 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.714243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e89e6-9a06-4fdf-8972-e57c27403313 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.718863 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6346-a87e-497f-b9ad-73e5ef0a5aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.719513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6346-a87e-497f-b9ad-73e5ef0a5aab admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.719810 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6346-a87e-497f-b9ad-73e5ef0a5aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.720099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd6346-a87e-497f-b9ad-73e5ef0a5aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.721023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd6346-a87e-497f-b9ad-73e5ef0a5aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.722849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd6346-a87e-497f-b9ad-73e5ef0a5aab admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.734911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1313/2596] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:48.739243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ee19e-5891-4a26-8f5a-810d00ceba17 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.749378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ee19e-5891-4a26-8f5a-810d00ceba17 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.754714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689eaa2-c0f8-4177-a13b-51873164f233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.755518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689eaa2-c0f8-4177-a13b-51873164f233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.755800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689eaa2-c0f8-4177-a13b-51873164f233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.756074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689eaa2-c0f8-4177-a13b-51873164f233 admin admin] PATH_INFO: `/v3/projects/7087a6d40697429a8570e635966b74a1/users/3cb21e7d685748e6872596b078bce9d1/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.770882 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689eaa2-c0f8-4177-a13b-51873164f233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7087a6d40697429a8570e635966b74a1, user_id=3cb21e7d685748e6872596b078bce9d1, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.773586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689eaa2-c0f8-4177-a13b-51873164f233 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.786519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1284/2597] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:48 2022] PUT /identity/v3/projects/7087a6d40697429a8570e635966b74a1/users/3cb21e7d685748e6872596b078bce9d1/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:13:48.790347 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6346-a87e-497f-b9ad-73e5ef0a5aab admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.796824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:48.801724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd6346-a87e-497f-b9ad-73e5ef0a5aab admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.859665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89f471-b041-4651-83e2-dc5e1dfecc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.860352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89f471-b041-4651-83e2-dc5e1dfecc7e admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.860642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89f471-b041-4651-83e2-dc5e1dfecc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.860915 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89f471-b041-4651-83e2-dc5e1dfecc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.861638 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89f471-b041-4651-83e2-dc5e1dfecc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.863723 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89f471-b041-4651-83e2-dc5e1dfecc7e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.873200 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1314/2598] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:48.877514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689eaa2-c0f8-4177-a13b-51873164f233 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:48.888252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689eaa2-c0f8-4177-a13b-51873164f233 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:48.893267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571d4f9-f408-4a44-bf65-3c367ceb8caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:48.894171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571d4f9-f408-4a44-bf65-3c367ceb8caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.894454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571d4f9-f408-4a44-bf65-3c367ceb8caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.894731 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571d4f9-f408-4a44-bf65-3c367ceb8caa admin admin] PATH_INFO: `/v3/projects/7087a6d40697429a8570e635966b74a1/users/3cb21e7d685748e6872596b078bce9d1/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.896729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571d4f9-f408-4a44-bf65-3c367ceb8caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7087a6d40697429a8570e635966b74a1, user_id=3cb21e7d685748e6872596b078bce9d1, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:48.899392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571d4f9-f408-4a44-bf65-3c367ceb8caa admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:48.909408 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1285/2599] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:48 2022] PUT /identity/v3/projects/7087a6d40697429a8570e635966b74a1/users/3cb21e7d685748e6872596b078bce9d1/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:48.920304 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508e5d-a5d8-44d9-a9c7-e0c367847ac4 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:48.920617 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508e5d-a5d8-44d9-a9c7-e0c367847ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:48.920896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b508e5d-a5d8-44d9-a9c7-e0c367847ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:48.951233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8b508e5d-a5d8-44d9-a9c7-e0c367847ac4 None None] MFA Rules not processed for user `3cb21e7d685748e6872596b078bce9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:48.952857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8b508e5d-a5d8-44d9-a9c7-e0c367847ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:49.026509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1315/2600] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:49.037279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571d4f9-f408-4a44-bf65-3c367ceb8caa admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:49.039109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4571d4f9-f408-4a44-bf65-3c367ceb8caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:49.097412 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571d4f9-f408-4a44-bf65-3c367ceb8caa admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:49.101097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e281-5c58-4dea-a7e9-7b9bbc42f647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:49.101740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e281-5c58-4dea-a7e9-7b9bbc42f647 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:49.102021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e281-5c58-4dea-a7e9-7b9bbc42f647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:49.102301 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e281-5c58-4dea-a7e9-7b9bbc42f647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:49.158639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273e281-5c58-4dea-a7e9-7b9bbc42f647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:49.160625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273e281-5c58-4dea-a7e9-7b9bbc42f647 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:49.169581 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1286/2601] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:53.342754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508e5d-a5d8-44d9-a9c7-e0c367847ac4 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:53.344174 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8b508e5d-a5d8-44d9-a9c7-e0c367847ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:53.355938 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b508e5d-a5d8-44d9-a9c7-e0c367847ac4 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:53.359467 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1343740-a820-493d-a6e4-7c617587202e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:53.360103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343740-a820-493d-a6e4-7c617587202e service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:53.360415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343740-a820-493d-a6e4-7c617587202e service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:53.360713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1343740-a820-493d-a6e4-7c617587202e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:53.369987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1343740-a820-493d-a6e4-7c617587202e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:53.371411 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1343740-a820-493d-a6e4-7c617587202e service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:53.381355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1316/2602] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:13:58.214403 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e281-5c58-4dea-a7e9-7b9bbc42f647 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.231716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:58.278482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e281-5c58-4dea-a7e9-7b9bbc42f647 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.282949 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.284387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.284689 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.284946 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] PATH_INFO: `/v3/users/dabfcf64c6614bb5a77f419b9e80759e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.286111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabfcf64c6614bb5a77f419b9e80759e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.288031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.332471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabfcf64c6614bb5a77f419b9e80759e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.333114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabfcf64c6614bb5a77f419b9e80759e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.339728 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabfcf64c6614bb5a77f419b9e80759e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.347492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabfcf64c6614bb5a77f419b9e80759e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.348106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabfcf64c6614bb5a77f419b9e80759e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.365657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1287/2603] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:58 2022] DELETE /identity/v3/users/dabfcf64c6614bb5a77f419b9e80759e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:58.370156 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5a9ff-ce6e-407d-a8f9-bf9f2909b9b4 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.370642 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5a9ff-ce6e-407d-a8f9-bf9f2909b9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.370754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5a9ff-ce6e-407d-a8f9-bf9f2909b9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.387696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-34b5a9ff-ce6e-407d-a8f9-bf9f2909b9b4 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:58.388911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-34b5a9ff-ce6e-407d-a8f9-bf9f2909b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.446914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1317/2604] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:58.456982 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.458475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.515095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a81e7-a60c-4737-bc2f-26d16fef4f2d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.519555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4c41d-5b2f-4e78-ac10-d8572e524c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.520200 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4c41d-5b2f-4e78-ac10-d8572e524c74 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.520513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4c41d-5b2f-4e78-ac10-d8572e524c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.520791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4c41d-5b2f-4e78-ac10-d8572e524c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.529665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4c41d-5b2f-4e78-ac10-d8572e524c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.531091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4c41d-5b2f-4e78-ac10-d8572e524c74 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.540485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1288/2605] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:13:58.803303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5a9ff-ce6e-407d-a8f9-bf9f2909b9b4 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.804812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-34b5a9ff-ce6e-407d-a8f9-bf9f2909b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:58.817565 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5a9ff-ce6e-407d-a8f9-bf9f2909b9b4 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.822437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.823899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.824382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.824670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] PATH_INFO: `/v3/projects/f64d3f38ef03460cb2013165b31df921` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.825939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64d3f38ef03460cb2013165b31df921)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.827850 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:58.836971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:58.876215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64d3f38ef03460cb2013165b31df921', 'request_id': 'req-37c5a4cc-b680-4603-a989-87ac12a39ca3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.882210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64d3f38ef03460cb2013165b31df921', 'request_id': 'req-37c5a4cc-b680-4603-a989-87ac12a39ca3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.889245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64d3f38ef03460cb2013165b31df921', 'request_id': 'req-37c5a4cc-b680-4603-a989-87ac12a39ca3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.903683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] The token cache is being invalidate because project f64d3f38ef03460cb2013165b31df921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:58.904097 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.904767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:58.906325 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1318/2606] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:58 2022] DELETE /identity/v3/projects/f64d3f38ef03460cb2013165b31df921 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:58.912227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4c41d-5b2f-4e78-ac10-d8572e524c74 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:58.922577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4c41d-5b2f-4e78-ac10-d8572e524c74 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:58.960405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:58.989108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee76177-e504-40a3-89df-3eb85bcf92fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:58.989887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee76177-e504-40a3-89df-3eb85bcf92fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:58.990171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee76177-e504-40a3-89df-3eb85bcf92fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:58.990445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee76177-e504-40a3-89df-3eb85bcf92fd admin admin] PATH_INFO: `/v3/users/3cb21e7d685748e6872596b078bce9d1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:58.991623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee76177-e504-40a3-89df-3eb85bcf92fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb21e7d685748e6872596b078bce9d1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:58.994010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee76177-e504-40a3-89df-3eb85bcf92fd admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.047941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7ee76177-e504-40a3-89df-3eb85bcf92fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb21e7d685748e6872596b078bce9d1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.048611 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7ee76177-e504-40a3-89df-3eb85bcf92fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb21e7d685748e6872596b078bce9d1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.055288 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7ee76177-e504-40a3-89df-3eb85bcf92fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb21e7d685748e6872596b078bce9d1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.062486 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7ee76177-e504-40a3-89df-3eb85bcf92fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb21e7d685748e6872596b078bce9d1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.063211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7ee76177-e504-40a3-89df-3eb85bcf92fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb21e7d685748e6872596b078bce9d1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.082969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1289/2607] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:13:58 2022] DELETE /identity/v3/users/3cb21e7d685748e6872596b078bce9d1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:59.373927 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.375361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:59.389368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5a4cc-b680-4603-a989-87ac12a39ca3 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.448646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.449509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.449798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.450072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] PATH_INFO: `/v3/projects/7087a6d40697429a8570e635966b74a1` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.451258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7087a6d40697429a8570e635966b74a1)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.453212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.500371 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7087a6d40697429a8570e635966b74a1', 'request_id': 'req-5627bf84-8cb1-4f53-b4a9-a6806a802063'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.506185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7087a6d40697429a8570e635966b74a1', 'request_id': 'req-5627bf84-8cb1-4f53-b4a9-a6806a802063'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.512164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7087a6d40697429a8570e635966b74a1', 'request_id': 'req-5627bf84-8cb1-4f53-b4a9-a6806a802063'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.524094 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] The token cache is being invalidate because project 7087a6d40697429a8570e635966b74a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:13:59.524428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.525049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5627bf84-8cb1-4f53-b4a9-a6806a802063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:13:59.526577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1319/2608] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:13:59 2022] DELETE /identity/v3/projects/7087a6d40697429a8570e635966b74a1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:59.533650 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0badd5-2e00-4719-92d5-4c90f9c23065 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.534166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0badd5-2e00-4719-92d5-4c90f9c23065 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.534273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0badd5-2e00-4719-92d5-4c90f9c23065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.552040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-3f0badd5-2e00-4719-92d5-4c90f9c23065 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:59.553272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-3f0badd5-2e00-4719-92d5-4c90f9c23065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:59.615518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1290/2609] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:59.623957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60fd57-282d-47fc-8e8e-8ed2b8af10ff None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.624159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60fd57-282d-47fc-8e8e-8ed2b8af10ff None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.624473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60fd57-282d-47fc-8e8e-8ed2b8af10ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.644441 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-fc60fd57-282d-47fc-8e8e-8ed2b8af10ff None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:13:59.645647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-fc60fd57-282d-47fc-8e8e-8ed2b8af10ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:13:59.653906 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1320/2610] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:13:59.658144 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0badd5-2e00-4719-92d5-4c90f9c23065 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.668433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0badd5-2e00-4719-92d5-4c90f9c23065 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.673026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e8c3-53d5-4540-9ae5-de676dd513b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.673681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e8c3-53d5-4540-9ae5-de676dd513b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.673965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e8c3-53d5-4540-9ae5-de676dd513b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.674239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e8c3-53d5-4540-9ae5-de676dd513b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.674989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95e8c3-53d5-4540-9ae5-de676dd513b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:13:59.675294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95e8c3-53d5-4540-9ae5-de676dd513b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.676959 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95e8c3-53d5-4540-9ae5-de676dd513b3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.688668 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1291/2611] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:13:59.693571 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60fd57-282d-47fc-8e8e-8ed2b8af10ff None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.704466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60fd57-282d-47fc-8e8e-8ed2b8af10ff None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.709787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14d644-2457-43a2-a5b5-fb9fb5851e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.710434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14d644-2457-43a2-a5b5-fb9fb5851e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.710746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14d644-2457-43a2-a5b5-fb9fb5851e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.711020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14d644-2457-43a2-a5b5-fb9fb5851e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.711713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14d644-2457-43a2-a5b5-fb9fb5851e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.713664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14d644-2457-43a2-a5b5-fb9fb5851e1f admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.733634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:59.742996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1321/2612] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:13:59.746964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e8c3-53d5-4540-9ae5-de676dd513b3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.757828 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e8c3-53d5-4540-9ae5-de676dd513b3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.804010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:59.825905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389ce7-2607-443b-a23c-c08d2f8ee03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.826912 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389ce7-2607-443b-a23c-c08d2f8ee03c admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.827312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389ce7-2607-443b-a23c-c08d2f8ee03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.827672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389ce7-2607-443b-a23c-c08d2f8ee03c admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.828736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e389ce7-2607-443b-a23c-c08d2f8ee03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.832184 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e389ce7-2607-443b-a23c-c08d2f8ee03c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.858995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1292/2613] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:13:59.860210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14d644-2457-43a2-a5b5-fb9fb5851e1f admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.871210 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14d644-2457-43a2-a5b5-fb9fb5851e1f admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.875976 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df371c14-4aff-4e0b-a680-bec18a9f86ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.876649 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371c14-4aff-4e0b-a680-bec18a9f86ca admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.876939 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371c14-4aff-4e0b-a680-bec18a9f86ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.877729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371c14-4aff-4e0b-a680-bec18a9f86ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.878472 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df371c14-4aff-4e0b-a680-bec18a9f86ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.880070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df371c14-4aff-4e0b-a680-bec18a9f86ca admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.890675 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1322/2614] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:59.895534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389ce7-2607-443b-a23c-c08d2f8ee03c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.905894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389ce7-2607-443b-a23c-c08d2f8ee03c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.911773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71a41c-64cb-43ac-a1e2-ccd0a5c795e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.912952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71a41c-64cb-43ac-a1e2-ccd0a5c795e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.913476 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71a41c-64cb-43ac-a1e2-ccd0a5c795e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.913986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71a41c-64cb-43ac-a1e2-ccd0a5c795e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.915096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71a41c-64cb-43ac-a1e2-ccd0a5c795e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.916747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71a41c-64cb-43ac-a1e2-ccd0a5c795e1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.929141 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1293/2615] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:13:59.933276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df371c14-4aff-4e0b-a680-bec18a9f86ca admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:13:59.944029 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df371c14-4aff-4e0b-a680-bec18a9f86ca admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:13:59.948983 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc17d8-3926-42f8-aaf9-e3d0d6122095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:13:59.949941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc17d8-3926-42f8-aaf9-e3d0d6122095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.950294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc17d8-3926-42f8-aaf9-e3d0d6122095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.950777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc17d8-3926-42f8-aaf9-e3d0d6122095 admin admin] PATH_INFO: `/v3/projects/d9a990da1dfe4ba189fa9ef0856d5b57/users/a1e2b838931c4c1ab97c391b34937f2e/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:13:59.966582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc17d8-3926-42f8-aaf9-e3d0d6122095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a990da1dfe4ba189fa9ef0856d5b57, user_id=a1e2b838931c4c1ab97c391b34937f2e, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:13:59.969398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc17d8-3926-42f8-aaf9-e3d0d6122095 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:13:59.983057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1323/2616] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:13:59 2022] PUT /identity/v3/projects/d9a990da1dfe4ba189fa9ef0856d5b57/users/a1e2b838931c4c1ab97c391b34937f2e/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:13:59.988621 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cfc82-8af0-45a3-8848-4e49bba8ccdb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:13:59.988917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cfc82-8af0-45a3-8848-4e49bba8ccdb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:13:59.989193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cfc82-8af0-45a3-8848-4e49bba8ccdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.008274 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-7d4cfc82-8af0-45a3-8848-4e49bba8ccdb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:00.009525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7d4cfc82-8af0-45a3-8848-4e49bba8ccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.068914 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1294/2617] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:00.078817 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc17d8-3926-42f8-aaf9-e3d0d6122095 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:00.080567 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-43bc17d8-3926-42f8-aaf9-e3d0d6122095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.141897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc17d8-3926-42f8-aaf9-e3d0d6122095 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:00.145605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3e927-8619-43ea-a748-08a42eea32f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:00.146248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3e927-8619-43ea-a748-08a42eea32f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:00.146533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3e927-8619-43ea-a748-08a42eea32f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:00.146813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3e927-8619-43ea-a748-08a42eea32f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.156182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3e927-8619-43ea-a748-08a42eea32f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:00.157660 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3e927-8619-43ea-a748-08a42eea32f7 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:00.167343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1324/2618] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:00.768633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece99314-34be-43cd-b2c8-e0b0abc97455 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:00.769158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece99314-34be-43cd-b2c8-e0b0abc97455 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:00.769256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece99314-34be-43cd-b2c8-e0b0abc97455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.795386 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ece99314-34be-43cd-b2c8-e0b0abc97455 None None] MFA Rules not processed for user `a1e2b838931c4c1ab97c391b34937f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:00.796647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ece99314-34be-43cd-b2c8-e0b0abc97455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.865721 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1295/2619] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:00.876522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3e927-8619-43ea-a748-08a42eea32f7 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:00.877925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-14e3e927-8619-43ea-a748-08a42eea32f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:00.935560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3e927-8619-43ea-a748-08a42eea32f7 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:00.939174 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243e13d-42b4-45d5-a051-87085ffe31f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:00.939857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243e13d-42b4-45d5-a051-87085ffe31f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:00.940142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243e13d-42b4-45d5-a051-87085ffe31f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:00.940535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243e13d-42b4-45d5-a051-87085ffe31f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:00.949148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243e13d-42b4-45d5-a051-87085ffe31f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:00.950580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243e13d-42b4-45d5-a051-87085ffe31f2 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:00.959994 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1325/2620] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:02.326480 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe777b-878e-4c7d-83fd-a60b069e106c None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:02.327378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe777b-878e-4c7d-83fd-a60b069e106c None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:02.327647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe777b-878e-4c7d-83fd-a60b069e106c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:02.346965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fbbe777b-878e-4c7d-83fd-a60b069e106c None None] MFA Rules not processed for user `a1e2b838931c4c1ab97c391b34937f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:02.348240 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fbbe777b-878e-4c7d-83fd-a60b069e106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:02.355357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1296/2621] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:06.947342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243e13d-42b4-45d5-a051-87085ffe31f2 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:06.948778 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1243e13d-42b4-45d5-a051-87085ffe31f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:06.961950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243e13d-42b4-45d5-a051-87085ffe31f2 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:06.964845 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573122b-a1f6-41cf-abfa-3324fcb06026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:06.965484 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573122b-a1f6-41cf-abfa-3324fcb06026 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:06.965768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573122b-a1f6-41cf-abfa-3324fcb06026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:06.966045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573122b-a1f6-41cf-abfa-3324fcb06026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:06.967779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c573122b-a1f6-41cf-abfa-3324fcb06026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:06.979867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573122b-a1f6-41cf-abfa-3324fcb06026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:06.981364 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573122b-a1f6-41cf-abfa-3324fcb06026 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:06.991704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1326/2622] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:10.072672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe777b-878e-4c7d-83fd-a60b069e106c None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.074106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fbbe777b-878e-4c7d-83fd-a60b069e106c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:10.096276 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe777b-878e-4c7d-83fd-a60b069e106c None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.101007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf4483-ab6f-4abe-a17c-4d150dd4a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.101878 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf4483-ab6f-4abe-a17c-4d150dd4a448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.102156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf4483-ab6f-4abe-a17c-4d150dd4a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.102425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf4483-ab6f-4abe-a17c-4d150dd4a448 admin admin] PATH_INFO: `/v3/users/6bad8a4de2c84319a8601e7625c2655e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.103612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf4483-ab6f-4abe-a17c-4d150dd4a448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bad8a4de2c84319a8601e7625c2655e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.105694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf4483-ab6f-4abe-a17c-4d150dd4a448 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.149489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:10.154967 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-41cf4483-ab6f-4abe-a17c-4d150dd4a448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bad8a4de2c84319a8601e7625c2655e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.155690 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-41cf4483-ab6f-4abe-a17c-4d150dd4a448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bad8a4de2c84319a8601e7625c2655e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.166595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-41cf4483-ab6f-4abe-a17c-4d150dd4a448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bad8a4de2c84319a8601e7625c2655e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.174861 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-41cf4483-ab6f-4abe-a17c-4d150dd4a448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bad8a4de2c84319a8601e7625c2655e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.175989 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-41cf4483-ab6f-4abe-a17c-4d150dd4a448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bad8a4de2c84319a8601e7625c2655e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.194250 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1297/2623] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:10 2022] DELETE /identity/v3/users/6bad8a4de2c84319a8601e7625c2655e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:10.367035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573122b-a1f6-41cf-abfa-3324fcb06026 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.380014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573122b-a1f6-41cf-abfa-3324fcb06026 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.439795 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:10.448207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.449105 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.449387 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.449661 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] PATH_INFO: `/v3/projects/2753e6f236134634837eddbfe2754764` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.450850 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2753e6f236134634837eddbfe2754764)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.452789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.499797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2753e6f236134634837eddbfe2754764', 'request_id': 'req-acb0ac3c-5eca-4426-91c2-d6bb003240d1'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.506300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2753e6f236134634837eddbfe2754764', 'request_id': 'req-acb0ac3c-5eca-4426-91c2-d6bb003240d1'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.512877 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2753e6f236134634837eddbfe2754764', 'request_id': 'req-acb0ac3c-5eca-4426-91c2-d6bb003240d1'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.529393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] The token cache is being invalidate because project 2753e6f236134634837eddbfe2754764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:10.529692 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.530317 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-acb0ac3c-5eca-4426-91c2-d6bb003240d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:10.531890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1327/2624] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:10 2022] DELETE /identity/v3/projects/2753e6f236134634837eddbfe2754764 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:10.536871 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9ffe-cf55-4855-93fe-64ce2ce6e5ee None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.537164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9ffe-cf55-4855-93fe-64ce2ce6e5ee None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.537440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9ffe-cf55-4855-93fe-64ce2ce6e5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.555849 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-45ec9ffe-cf55-4855-93fe-64ce2ce6e5ee None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:10.557067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-45ec9ffe-cf55-4855-93fe-64ce2ce6e5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:10.615190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1298/2625] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:10.622924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b46c-7f1e-4a1f-87f9-9b4fee14c12f None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.623214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b46c-7f1e-4a1f-87f9-9b4fee14c12f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.623495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b46c-7f1e-4a1f-87f9-9b4fee14c12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.642207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c594b46c-7f1e-4a1f-87f9-9b4fee14c12f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:10.643410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c594b46c-7f1e-4a1f-87f9-9b4fee14c12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:10.651345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1328/2626] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:10.655420 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec9ffe-cf55-4855-93fe-64ce2ce6e5ee None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.665009 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec9ffe-cf55-4855-93fe-64ce2ce6e5ee None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.669571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ce181-734e-4b4c-83c4-3f7bed69f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.670210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce181-734e-4b4c-83c4-3f7bed69f204 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.670492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce181-734e-4b4c-83c4-3f7bed69f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.670768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce181-734e-4b4c-83c4-3f7bed69f204 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.671480 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce181-734e-4b4c-83c4-3f7bed69f204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:10.671788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce181-734e-4b4c-83c4-3f7bed69f204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.673415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce181-734e-4b4c-83c4-3f7bed69f204 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.685173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1299/2627] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:10.689857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594b46c-7f1e-4a1f-87f9-9b4fee14c12f None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.699088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594b46c-7f1e-4a1f-87f9-9b4fee14c12f None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.703846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9c1a1-4a72-46e1-9da6-2a8034311853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.704615 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9c1a1-4a72-46e1-9da6-2a8034311853 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.705431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9c1a1-4a72-46e1-9da6-2a8034311853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.705719 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9c1a1-4a72-46e1-9da6-2a8034311853 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.706461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9c1a1-4a72-46e1-9da6-2a8034311853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.708453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9c1a1-4a72-46e1-9da6-2a8034311853 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.736245 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1329/2628] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:10.740296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ce181-734e-4b4c-83c4-3f7bed69f204 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.750687 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ce181-734e-4b4c-83c4-3f7bed69f204 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.809777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250a217-7144-4921-a058-149af035abae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.810631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a217-7144-4921-a058-149af035abae admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.811114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a217-7144-4921-a058-149af035abae admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.811114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250a217-7144-4921-a058-149af035abae admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.811692 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250a217-7144-4921-a058-149af035abae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.813627 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250a217-7144-4921-a058-149af035abae admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.833536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1300/2629] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:10.837745 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9c1a1-4a72-46e1-9da6-2a8034311853 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.848585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9c1a1-4a72-46e1-9da6-2a8034311853 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.853340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b4b9c-30ef-4952-a24a-76e6b4dd4236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.853988 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b4b9c-30ef-4952-a24a-76e6b4dd4236 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.854274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b4b9c-30ef-4952-a24a-76e6b4dd4236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.854558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b4b9c-30ef-4952-a24a-76e6b4dd4236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.855285 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b4b9c-30ef-4952-a24a-76e6b4dd4236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.856918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b4b9c-30ef-4952-a24a-76e6b4dd4236 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.867046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1330/2630] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:10.870938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250a217-7144-4921-a058-149af035abae admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.881400 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250a217-7144-4921-a058-149af035abae admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.888473 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d1842-7172-4d3d-8552-e4cb58062137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.889124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1842-7172-4d3d-8552-e4cb58062137 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.889410 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1842-7172-4d3d-8552-e4cb58062137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.889688 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d1842-7172-4d3d-8552-e4cb58062137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.890416 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d1842-7172-4d3d-8552-e4cb58062137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.892278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d1842-7172-4d3d-8552-e4cb58062137 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.902824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1301/2631] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:10.907220 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b4b9c-30ef-4952-a24a-76e6b4dd4236 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:10.918257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b4b9c-30ef-4952-a24a-76e6b4dd4236 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:10.923257 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5b41c-0e91-4ffc-92af-8ff97ab775fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:10.924254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5b41c-0e91-4ffc-92af-8ff97ab775fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.924569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5b41c-0e91-4ffc-92af-8ff97ab775fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.924836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5b41c-0e91-4ffc-92af-8ff97ab775fe admin admin] PATH_INFO: `/v3/projects/15d580e12adb4ffeaa6ec4ba6d4afa99/users/c34c84fa610d48deaae707fdbff9ce12/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:10.942901 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5b41c-0e91-4ffc-92af-8ff97ab775fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d580e12adb4ffeaa6ec4ba6d4afa99, user_id=c34c84fa610d48deaae707fdbff9ce12, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:10.945800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5b41c-0e91-4ffc-92af-8ff97ab775fe admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:10.961212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1331/2632] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:10 2022] PUT /identity/v3/projects/15d580e12adb4ffeaa6ec4ba6d4afa99/users/c34c84fa610d48deaae707fdbff9ce12/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:10.972561 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304dd17-a412-4681-ac28-c5ef1b8ec8b4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:10.972852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304dd17-a412-4681-ac28-c5ef1b8ec8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:10.973126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304dd17-a412-4681-ac28-c5ef1b8ec8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.000592 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c304dd17-a412-4681-ac28-c5ef1b8ec8b4 None None] MFA Rules not processed for user `c34c84fa610d48deaae707fdbff9ce12`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:11.002384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c304dd17-a412-4681-ac28-c5ef1b8ec8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.014463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:11.071437 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1302/2633] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:11.084320 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5b41c-0e91-4ffc-92af-8ff97ab775fe admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:11.086059 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5fb5b41c-0e91-4ffc-92af-8ff97ab775fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:11.158274 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5b41c-0e91-4ffc-92af-8ff97ab775fe admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:11.163893 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbe0f5-551c-43ee-ab00-c8c7d9177c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:11.164574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbe0f5-551c-43ee-ab00-c8c7d9177c76 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:11.164867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbe0f5-551c-43ee-ab00-c8c7d9177c76 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:11.165148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbe0f5-551c-43ee-ab00-c8c7d9177c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:11.173206 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbe0f5-551c-43ee-ab00-c8c7d9177c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:11.174821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbe0f5-551c-43ee-ab00-c8c7d9177c76 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:11.183623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1332/2634] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:16.383654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304dd17-a412-4681-ac28-c5ef1b8ec8b4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.446460 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304dd17-a412-4681-ac28-c5ef1b8ec8b4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.451131 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.452038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.452300 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.452596 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] PATH_INFO: `/v3/users/c34c84fa610d48deaae707fdbff9ce12` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.453824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34c84fa610d48deaae707fdbff9ce12)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.456463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.503490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34c84fa610d48deaae707fdbff9ce12'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.504151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34c84fa610d48deaae707fdbff9ce12'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.511142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34c84fa610d48deaae707fdbff9ce12'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.518614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34c84fa610d48deaae707fdbff9ce12'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.519242 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34c84fa610d48deaae707fdbff9ce12'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:16.537999 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1303/2635] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:16 2022] DELETE /identity/v3/users/c34c84fa610d48deaae707fdbff9ce12 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:16.542950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e670b-6510-4dfa-b5fb-bd31d70f832b None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.543436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e670b-6510-4dfa-b5fb-bd31d70f832b None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.543553 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e670b-6510-4dfa-b5fb-bd31d70f832b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.556230 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:16.563597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-3c1e670b-6510-4dfa-b5fb-bd31d70f832b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:16.566826 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3c1e670b-6510-4dfa-b5fb-bd31d70f832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:16.628388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1333/2636] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:16.638055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.639490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:16.675583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:16.699844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e7275-030a-4628-aa8e-848ba6cb2ff4 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:16.703762 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bfc8d-3215-442a-94ac-34be67833557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:16.704435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bfc8d-3215-442a-94ac-34be67833557 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:16.705227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bfc8d-3215-442a-94ac-34be67833557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:16.705501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bfc8d-3215-442a-94ac-34be67833557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:16.714894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bfc8d-3215-442a-94ac-34be67833557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:16.716391 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438bfc8d-3215-442a-94ac-34be67833557 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:16.726428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1304/2637] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:16.995073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e670b-6510-4dfa-b5fb-bd31d70f832b None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:16.996804 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3c1e670b-6510-4dfa-b5fb-bd31d70f832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.010223 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e670b-6510-4dfa-b5fb-bd31d70f832b None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.015766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.017236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.018207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.018570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] PATH_INFO: `/v3/projects/15d580e12adb4ffeaa6ec4ba6d4afa99` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.019846 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d580e12adb4ffeaa6ec4ba6d4afa99)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.022176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.073043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d580e12adb4ffeaa6ec4ba6d4afa99', 'request_id': 'req-742cda23-8f70-4ed5-899a-297a00963b69'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.078871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d580e12adb4ffeaa6ec4ba6d4afa99', 'request_id': 'req-742cda23-8f70-4ed5-899a-297a00963b69'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.085653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d580e12adb4ffeaa6ec4ba6d4afa99', 'request_id': 'req-742cda23-8f70-4ed5-899a-297a00963b69'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.098722 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] The token cache is being invalidate because project 15d580e12adb4ffeaa6ec4ba6d4afa99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:17.099005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.099639 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-742cda23-8f70-4ed5-899a-297a00963b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:17.101410 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1334/2638] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:16 2022] DELETE /identity/v3/projects/15d580e12adb4ffeaa6ec4ba6d4afa99 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:17.106511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38d77d-d99a-4f78-9d99-8595bb0011a3 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.106802 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38d77d-d99a-4f78-9d99-8595bb0011a3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.107082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38d77d-d99a-4f78-9d99-8595bb0011a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.124866 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0d38d77d-d99a-4f78-9d99-8595bb0011a3 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:17.126078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0d38d77d-d99a-4f78-9d99-8595bb0011a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.185674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1305/2639] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:17.193868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1fde7-633f-49e6-9bf4-e935e9640bca None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.194192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1fde7-633f-49e6-9bf4-e935e9640bca None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.195237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1fde7-633f-49e6-9bf4-e935e9640bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.214807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b5a1fde7-633f-49e6-9bf4-e935e9640bca None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:17.216036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b5a1fde7-633f-49e6-9bf4-e935e9640bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.224172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1335/2640] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:17.228603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38d77d-d99a-4f78-9d99-8595bb0011a3 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.240743 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38d77d-d99a-4f78-9d99-8595bb0011a3 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.248010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153e500-3a31-4ec1-a936-607ac57ba5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.249205 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e500-3a31-4ec1-a936-607ac57ba5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.249657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e500-3a31-4ec1-a936-607ac57ba5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.249929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e500-3a31-4ec1-a936-607ac57ba5d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.250670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153e500-3a31-4ec1-a936-607ac57ba5d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:17.251013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153e500-3a31-4ec1-a936-607ac57ba5d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.253271 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153e500-3a31-4ec1-a936-607ac57ba5d2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.265157 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1306/2641] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:17.270502 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1fde7-633f-49e6-9bf4-e935e9640bca None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.280006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1fde7-633f-49e6-9bf4-e935e9640bca None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.284894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4068ae5-6a09-437f-9634-d4383466dc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.285574 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068ae5-6a09-437f-9634-d4383466dc80 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.285856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068ae5-6a09-437f-9634-d4383466dc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.286128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4068ae5-6a09-437f-9634-d4383466dc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.286815 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4068ae5-6a09-437f-9634-d4383466dc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.288721 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4068ae5-6a09-437f-9634-d4383466dc80 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.321035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1336/2642] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:17.325573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153e500-3a31-4ec1-a936-607ac57ba5d2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.336254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153e500-3a31-4ec1-a936-607ac57ba5d2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.395854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ff6c-3fd1-483b-9e12-b8a5e6dd4b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.396595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ff6c-3fd1-483b-9e12-b8a5e6dd4b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.396829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ff6c-3fd1-483b-9e12-b8a5e6dd4b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.397106 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ff6c-3fd1-483b-9e12-b8a5e6dd4b0c admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.397812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126ff6c-3fd1-483b-9e12-b8a5e6dd4b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.399742 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126ff6c-3fd1-483b-9e12-b8a5e6dd4b0c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.421541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1307/2643] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:17.425640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4068ae5-6a09-437f-9634-d4383466dc80 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.435917 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4068ae5-6a09-437f-9634-d4383466dc80 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.440409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34b9d3-74a5-4710-90d8-9bb368e41615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.441058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34b9d3-74a5-4710-90d8-9bb368e41615 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.441340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34b9d3-74a5-4710-90d8-9bb368e41615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.441614 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34b9d3-74a5-4710-90d8-9bb368e41615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.442332 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34b9d3-74a5-4710-90d8-9bb368e41615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.443914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34b9d3-74a5-4710-90d8-9bb368e41615 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.455207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1337/2644] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:17.459169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ff6c-3fd1-483b-9e12-b8a5e6dd4b0c admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.469446 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ff6c-3fd1-483b-9e12-b8a5e6dd4b0c admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.474662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1af6bc-bba3-4950-9a56-239c1e4d6ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.475309 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1af6bc-bba3-4950-9a56-239c1e4d6ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.475629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1af6bc-bba3-4950-9a56-239c1e4d6ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.475903 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1af6bc-bba3-4950-9a56-239c1e4d6ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.476660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1af6bc-bba3-4950-9a56-239c1e4d6ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.478266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1af6bc-bba3-4950-9a56-239c1e4d6ef6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.488291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1308/2645] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:17.492428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34b9d3-74a5-4710-90d8-9bb368e41615 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.503171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34b9d3-74a5-4710-90d8-9bb368e41615 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.510039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d8a8-89ca-492d-82b7-b658c384b615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.510926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d8a8-89ca-492d-82b7-b658c384b615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.511212 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d8a8-89ca-492d-82b7-b658c384b615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.511490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d8a8-89ca-492d-82b7-b658c384b615 admin admin] PATH_INFO: `/v3/projects/b0d35894d0704809b1be31665cc211eb/users/bd291db1f15c4c3b9a016f3d457bb020/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.527730 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2d8a8-89ca-492d-82b7-b658c384b615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d35894d0704809b1be31665cc211eb, user_id=bd291db1f15c4c3b9a016f3d457bb020, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.530431 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2d8a8-89ca-492d-82b7-b658c384b615 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.544602 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1338/2646] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:17 2022] PUT /identity/v3/projects/b0d35894d0704809b1be31665cc211eb/users/bd291db1f15c4c3b9a016f3d457bb020/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:17.555684 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ff86-fab5-4e0a-8a7b-16be8ce01e72 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.555979 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ff86-fab5-4e0a-8a7b-16be8ce01e72 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.556264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ff86-fab5-4e0a-8a7b-16be8ce01e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.584513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1c15ff86-fab5-4e0a-8a7b-16be8ce01e72 None None] MFA Rules not processed for user `bd291db1f15c4c3b9a016f3d457bb020`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:17.585740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1c15ff86-fab5-4e0a-8a7b-16be8ce01e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:17.626349 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:17.656005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1309/2647] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:17.661568 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d8a8-89ca-492d-82b7-b658c384b615 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.693196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:17.729852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d8a8-89ca-492d-82b7-b658c384b615 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.734538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed70687-fbd1-4527-8892-f03d90bb699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.735192 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed70687-fbd1-4527-8892-f03d90bb699a admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.735471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed70687-fbd1-4527-8892-f03d90bb699a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.735759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed70687-fbd1-4527-8892-f03d90bb699a admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.736506 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed70687-fbd1-4527-8892-f03d90bb699a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.738924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed70687-fbd1-4527-8892-f03d90bb699a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.764601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1339/2648] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:17.769102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15ff86-fab5-4e0a-8a7b-16be8ce01e72 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.779898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15ff86-fab5-4e0a-8a7b-16be8ce01e72 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.846851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211ca3f-c1d3-4bfe-babe-c303d00f5c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.847529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ca3f-c1d3-4bfe-babe-c303d00f5c46 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.847810 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ca3f-c1d3-4bfe-babe-c303d00f5c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.848080 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ca3f-c1d3-4bfe-babe-c303d00f5c46 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.848811 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211ca3f-c1d3-4bfe-babe-c303d00f5c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.850764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211ca3f-c1d3-4bfe-babe-c303d00f5c46 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.871842 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1310/2649] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:17 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:17.876153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed70687-fbd1-4527-8892-f03d90bb699a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.886672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed70687-fbd1-4527-8892-f03d90bb699a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.891658 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb565caa-ef18-4bac-a7f7-01e0f1cc943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.892374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565caa-ef18-4bac-a7f7-01e0f1cc943c admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.892664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565caa-ef18-4bac-a7f7-01e0f1cc943c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.892967 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565caa-ef18-4bac-a7f7-01e0f1cc943c admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.893696 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb565caa-ef18-4bac-a7f7-01e0f1cc943c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.895310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb565caa-ef18-4bac-a7f7-01e0f1cc943c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.905493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1340/2650] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:17.912267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211ca3f-c1d3-4bfe-babe-c303d00f5c46 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.925053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211ca3f-c1d3-4bfe-babe-c303d00f5c46 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:17.930244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfca1f-ae85-47cc-b3d2-9860bda1bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:17.931272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfca1f-ae85-47cc-b3d2-9860bda1bb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:17.931547 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfca1f-ae85-47cc-b3d2-9860bda1bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:17.931846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfca1f-ae85-47cc-b3d2-9860bda1bb70 admin admin] PATH_INFO: `/v3/projects/91dd2c4bb62b406996d3440ee6fbdbf0/users/0ef51e651b614fa791c4b04d7eb8a92e/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:17.948558 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfca1f-ae85-47cc-b3d2-9860bda1bb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91dd2c4bb62b406996d3440ee6fbdbf0, user_id=0ef51e651b614fa791c4b04d7eb8a92e, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:17.951629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfca1f-ae85-47cc-b3d2-9860bda1bb70 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:17.965908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1311/2651] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:17 2022] PUT /identity/v3/projects/91dd2c4bb62b406996d3440ee6fbdbf0/users/0ef51e651b614fa791c4b04d7eb8a92e/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:17.970069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb565caa-ef18-4bac-a7f7-01e0f1cc943c admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:17.980712 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb565caa-ef18-4bac-a7f7-01e0f1cc943c admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.037975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677a29b-0733-4192-b181-8c7d2a693713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.038640 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677a29b-0733-4192-b181-8c7d2a693713 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.038920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677a29b-0733-4192-b181-8c7d2a693713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.039237 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677a29b-0733-4192-b181-8c7d2a693713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.039923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677a29b-0733-4192-b181-8c7d2a693713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.041578 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677a29b-0733-4192-b181-8c7d2a693713 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.052330 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1341/2652] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:18.056778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfca1f-ae85-47cc-b3d2-9860bda1bb70 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.068466 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfca1f-ae85-47cc-b3d2-9860bda1bb70 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.073083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7eb47-1ea4-4bb6-ac13-63278ee5f239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.073984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7eb47-1ea4-4bb6-ac13-63278ee5f239 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.074266 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7eb47-1ea4-4bb6-ac13-63278ee5f239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.074540 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7eb47-1ea4-4bb6-ac13-63278ee5f239 admin admin] PATH_INFO: `/v3/projects/91dd2c4bb62b406996d3440ee6fbdbf0/users/0ef51e651b614fa791c4b04d7eb8a92e/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.076506 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7eb47-1ea4-4bb6-ac13-63278ee5f239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91dd2c4bb62b406996d3440ee6fbdbf0, user_id=0ef51e651b614fa791c4b04d7eb8a92e, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.080109 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7eb47-1ea4-4bb6-ac13-63278ee5f239 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.092196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1312/2653] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:18 2022] PUT /identity/v3/projects/91dd2c4bb62b406996d3440ee6fbdbf0/users/0ef51e651b614fa791c4b04d7eb8a92e/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:18.109062 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302ec04-1fd7-4848-90a9-5271e0f65107 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.109354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302ec04-1fd7-4848-90a9-5271e0f65107 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.109635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302ec04-1fd7-4848-90a9-5271e0f65107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.138202 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8302ec04-1fd7-4848-90a9-5271e0f65107 None None] MFA Rules not processed for user `0ef51e651b614fa791c4b04d7eb8a92e`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:18.139392 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8302ec04-1fd7-4848-90a9-5271e0f65107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:18.209048 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1342/2654] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:18.219684 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7eb47-1ea4-4bb6-ac13-63278ee5f239 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:18.222150 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e2b7eb47-1ea4-4bb6-ac13-63278ee5f239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:18.285604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7eb47-1ea4-4bb6-ac13-63278ee5f239 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:18.289367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738626f-d72b-4712-93be-8e119c54b369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:18.290017 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738626f-d72b-4712-93be-8e119c54b369 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:18.290303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738626f-d72b-4712-93be-8e119c54b369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:18.290582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738626f-d72b-4712-93be-8e119c54b369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:18.330149 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:18.349918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738626f-d72b-4712-93be-8e119c54b369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:18.351541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738626f-d72b-4712-93be-8e119c54b369 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:18.361431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1313/2655] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:20.909829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302ec04-1fd7-4848-90a9-5271e0f65107 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:20.911377 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8302ec04-1fd7-4848-90a9-5271e0f65107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:20.925128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302ec04-1fd7-4848-90a9-5271e0f65107 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:20.928690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5b59f-3e41-43f5-98f6-e58d97e1183a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:20.929323 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5b59f-3e41-43f5-98f6-e58d97e1183a service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:20.929606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5b59f-3e41-43f5-98f6-e58d97e1183a service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:20.929883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5b59f-3e41-43f5-98f6-e58d97e1183a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:20.940908 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5b59f-3e41-43f5-98f6-e58d97e1183a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:20.942344 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5b59f-3e41-43f5-98f6-e58d97e1183a service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:20.952398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1343/2656] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:28.356755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=10 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:30.947788 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:31.124093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb231317-56c1-48e4-b4cd-b13f96633af0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.124618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb231317-56c1-48e4-b4cd-b13f96633af0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.124821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb231317-56c1-48e4-b4cd-b13f96633af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.144797 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-fb231317-56c1-48e4-b4cd-b13f96633af0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:31.146007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-fb231317-56c1-48e4-b4cd-b13f96633af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.207502 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1314/2657] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jun 20 06:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:31.240307 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5b59f-3e41-43f5-98f6-e58d97e1183a service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:31.243454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e0d5b59f-3e41-43f5-98f6-e58d97e1183a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:31.323920 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5b59f-3e41-43f5-98f6-e58d97e1183a service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:31.329384 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec4c84-c12a-4fc5-8fb6-9f912eae2fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:31.330032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4c84-c12a-4fc5-8fb6-9f912eae2fc0 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:31.330323 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4c84-c12a-4fc5-8fb6-9f912eae2fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:31.330602 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4c84-c12a-4fc5-8fb6-9f912eae2fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:31.338936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec4c84-c12a-4fc5-8fb6-9f912eae2fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:31.340568 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec4c84-c12a-4fc5-8fb6-9f912eae2fc0 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:31.350538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1344/2658] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:33.443506 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb231317-56c1-48e4-b4cd-b13f96633af0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:33.453451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb231317-56c1-48e4-b4cd-b13f96633af0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:33.459481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:33.460360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:33.460646 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:33.460918 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] PATH_INFO: `/v3/users/bd291db1f15c4c3b9a016f3d457bb020` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:33.462098 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd291db1f15c4c3b9a016f3d457bb020)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:33.464005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:33.509658 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd291db1f15c4c3b9a016f3d457bb020'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:33.510243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd291db1f15c4c3b9a016f3d457bb020'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:33.517326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd291db1f15c4c3b9a016f3d457bb020'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:33.524603 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd291db1f15c4c3b9a016f3d457bb020'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:33.525210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd291db1f15c4c3b9a016f3d457bb020'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:33.543960 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1315/2659] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:33 2022] DELETE /identity/v3/users/bd291db1f15c4c3b9a016f3d457bb020 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:33.549055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e5a7d-c035-4527-a108-064eceae5bbc None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:33.549539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e5a7d-c035-4527-a108-064eceae5bbc None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:33.549646 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e5a7d-c035-4527-a108-064eceae5bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:33.566957 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-994e5a7d-c035-4527-a108-064eceae5bbc None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:33.568154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-994e5a7d-c035-4527-a108-064eceae5bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:33.630433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1345/2660] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:33.642190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:33.643632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:33.703329 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791487d-1705-43d9-a58c-4171a1132e79 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:33.707565 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b254aaa-6765-4959-81e0-046c16511567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:33.708202 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b254aaa-6765-4959-81e0-046c16511567 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:33.708514 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b254aaa-6765-4959-81e0-046c16511567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:33.708796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b254aaa-6765-4959-81e0-046c16511567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:33.717958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b254aaa-6765-4959-81e0-046c16511567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:33.719393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b254aaa-6765-4959-81e0-046c16511567 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:33.728975 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1316/2661] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:34.014148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e5a7d-c035-4527-a108-064eceae5bbc None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:34.015805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-994e5a7d-c035-4527-a108-064eceae5bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:34.030699 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e5a7d-c035-4527-a108-064eceae5bbc None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:34.046864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:34.049179 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:34.049812 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:34.050342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] PATH_INFO: `/v3/projects/b0d35894d0704809b1be31665cc211eb` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:34.069151 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d35894d0704809b1be31665cc211eb)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:34.071103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:34.121459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d35894d0704809b1be31665cc211eb', 'request_id': 'req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.127283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d35894d0704809b1be31665cc211eb', 'request_id': 'req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.133866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d35894d0704809b1be31665cc211eb', 'request_id': 'req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.146167 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] The token cache is being invalidate because project b0d35894d0704809b1be31665cc211eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:34.146452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.147063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-05836ad6-bb1d-4f7a-90aa-3f09b035e3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.148624 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1346/2662] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:34 2022] DELETE /identity/v3/projects/b0d35894d0704809b1be31665cc211eb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:14:34.152608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b254aaa-6765-4959-81e0-046c16511567 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:34.163057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b254aaa-6765-4959-81e0-046c16511567 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:34.176793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:34.199772 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af377fb-e79c-450e-a641-bfa8e769b7a2 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:34.200066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af377fb-e79c-450e-a641-bfa8e769b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:34.200376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af377fb-e79c-450e-a641-bfa8e769b7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:34.218346 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-3af377fb-e79c-450e-a641-bfa8e769b7a2 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:34.220089 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3af377fb-e79c-450e-a641-bfa8e769b7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:34.224339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:34.225361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:34.225737 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:34.226091 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] PATH_INFO: `/v3/users/0ef51e651b614fa791c4b04d7eb8a92e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:34.227407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef51e651b614fa791c4b04d7eb8a92e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:34.228381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1347/2663] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jun 20 06:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:34.229374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:34.251437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af377fb-e79c-450e-a641-bfa8e769b7a2 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:34.252870 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3af377fb-e79c-450e-a641-bfa8e769b7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:34.258130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:34.280777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef51e651b614fa791c4b04d7eb8a92e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.281624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef51e651b614fa791c4b04d7eb8a92e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.289236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef51e651b614fa791c4b04d7eb8a92e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.299083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef51e651b614fa791c4b04d7eb8a92e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.299748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef51e651b614fa791c4b04d7eb8a92e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.318845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1317/2664] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:34 2022] DELETE /identity/v3/users/0ef51e651b614fa791c4b04d7eb8a92e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:34.334222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af377fb-e79c-450e-a641-bfa8e769b7a2 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:34.400716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308154a-01cf-4c16-a9e2-0256a5deaa58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:34.401369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308154a-01cf-4c16-a9e2-0256a5deaa58 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:34.401657 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308154a-01cf-4c16-a9e2-0256a5deaa58 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:34.401942 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308154a-01cf-4c16-a9e2-0256a5deaa58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:34.403902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-f308154a-01cf-4c16-a9e2-0256a5deaa58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:34.480117 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308154a-01cf-4c16-a9e2-0256a5deaa58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:34.481839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308154a-01cf-4c16-a9e2-0256a5deaa58 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:34.492269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1348/2665] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:14:34.593946 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:34.595539 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:34.614783 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dd521-bc7e-474e-8f2c-ebd3e8749109 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:34.621237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:34.622000 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:34.622171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:34.622527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] PATH_INFO: `/v3/projects/91dd2c4bb62b406996d3440ee6fbdbf0` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:34.623888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91dd2c4bb62b406996d3440ee6fbdbf0)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:34.626373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:34.674042 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91dd2c4bb62b406996d3440ee6fbdbf0', 'request_id': 'req-fdc729a6-d10d-4355-a90a-54d53eedf9f6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.679448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91dd2c4bb62b406996d3440ee6fbdbf0', 'request_id': 'req-fdc729a6-d10d-4355-a90a-54d53eedf9f6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.686854 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91dd2c4bb62b406996d3440ee6fbdbf0', 'request_id': 'req-fdc729a6-d10d-4355-a90a-54d53eedf9f6'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.698386 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] The token cache is being invalidate because project 91dd2c4bb62b406996d3440ee6fbdbf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:34.698674 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.699296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fdc729a6-d10d-4355-a90a-54d53eedf9f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:34.700862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1318/2666] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:34 2022] DELETE /identity/v3/projects/91dd2c4bb62b406996d3440ee6fbdbf0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:34.706160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa848fa-a7e3-4c39-917a-d056213ffb41 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:34.706669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa848fa-a7e3-4c39-917a-d056213ffb41 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:34.706770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa848fa-a7e3-4c39-917a-d056213ffb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:34.724446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-dfa848fa-a7e3-4c39-917a-d056213ffb41 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:34.725641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-dfa848fa-a7e3-4c39-917a-d056213ffb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:34.755102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:34.788172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1349/2667] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:34.795816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2569e-fde9-4fc7-a260-69b582bfd5eb None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:34.796108 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2569e-fde9-4fc7-a260-69b582bfd5eb None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:34.796418 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2569e-fde9-4fc7-a260-69b582bfd5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:34.814507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b9c2569e-fde9-4fc7-a260-69b582bfd5eb None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:34.815708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b9c2569e-fde9-4fc7-a260-69b582bfd5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:34.823575 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1319/2668] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:34.827508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa848fa-a7e3-4c39-917a-d056213ffb41 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:34.837710 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa848fa-a7e3-4c39-917a-d056213ffb41 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:34.842218 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407208-3d7b-4a18-aedc-c0760a6330ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:34.842854 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407208-3d7b-4a18-aedc-c0760a6330ac admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:34.843139 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407208-3d7b-4a18-aedc-c0760a6330ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:34.843411 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4407208-3d7b-4a18-aedc-c0760a6330ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:34.844124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407208-3d7b-4a18-aedc-c0760a6330ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:34.844519 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407208-3d7b-4a18-aedc-c0760a6330ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:34.846597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4407208-3d7b-4a18-aedc-c0760a6330ac admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:34.857761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1350/2669] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:34.861799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2569e-fde9-4fc7-a260-69b582bfd5eb None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:34.870958 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2569e-fde9-4fc7-a260-69b582bfd5eb None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:34.876145 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8bc44-d326-4c6b-a3a0-6afa874e9b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:34.876820 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8bc44-d326-4c6b-a3a0-6afa874e9b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:34.877101 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8bc44-d326-4c6b-a3a0-6afa874e9b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:34.877375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8bc44-d326-4c6b-a3a0-6afa874e9b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:34.878067 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8bc44-d326-4c6b-a3a0-6afa874e9b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:34.879966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8bc44-d326-4c6b-a3a0-6afa874e9b3b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:34.888259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:34.907837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1320/2670] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:34 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:34.911926 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407208-3d7b-4a18-aedc-c0760a6330ac admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:34.921796 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4407208-3d7b-4a18-aedc-c0760a6330ac admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:34.991651 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a2ddb-b9be-4673-87bf-026cf558919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:34.992375 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2ddb-b9be-4673-87bf-026cf558919b admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:34.992665 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2ddb-b9be-4673-87bf-026cf558919b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:34.993136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2ddb-b9be-4673-87bf-026cf558919b admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:34.993644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a2ddb-b9be-4673-87bf-026cf558919b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:34.995573 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a2ddb-b9be-4673-87bf-026cf558919b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.014612 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1351/2671] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:34 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:35.019602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8bc44-d326-4c6b-a3a0-6afa874e9b3b admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.030415 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8bc44-d326-4c6b-a3a0-6afa874e9b3b admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.035179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce847-496b-436d-abe4-6683dec15d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.035833 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce847-496b-436d-abe4-6683dec15d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.036113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce847-496b-436d-abe4-6683dec15d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.036414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ce847-496b-436d-abe4-6683dec15d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.037132 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ce847-496b-436d-abe4-6683dec15d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.038748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ce847-496b-436d-abe4-6683dec15d7e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.048668 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1321/2672] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:35.052701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a2ddb-b9be-4673-87bf-026cf558919b admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.062757 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a2ddb-b9be-4673-87bf-026cf558919b admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.067925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e68bd-435c-4483-964a-508f3158ed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.068610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e68bd-435c-4483-964a-508f3158ed73 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.068902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e68bd-435c-4483-964a-508f3158ed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.069208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e68bd-435c-4483-964a-508f3158ed73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.069935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e68bd-435c-4483-964a-508f3158ed73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.071532 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e68bd-435c-4483-964a-508f3158ed73 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.085463 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1352/2673] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:35.086673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce847-496b-436d-abe4-6683dec15d7e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.096733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ce847-496b-436d-abe4-6683dec15d7e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.101438 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b48ec8-637d-41dc-8ea8-4b6e40befe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.102315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48ec8-637d-41dc-8ea8-4b6e40befe43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.102599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48ec8-637d-41dc-8ea8-4b6e40befe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.102879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48ec8-637d-41dc-8ea8-4b6e40befe43 admin admin] PATH_INFO: `/v3/projects/52cab571f4be4f4c99c6869378d161c2/users/efd6bfbfa0ef435ba141895cca6d866e/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.117190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b48ec8-637d-41dc-8ea8-4b6e40befe43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cab571f4be4f4c99c6869378d161c2, user_id=efd6bfbfa0ef435ba141895cca6d866e, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.119841 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b48ec8-637d-41dc-8ea8-4b6e40befe43 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.133017 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1322/2674] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:35 2022] PUT /identity/v3/projects/52cab571f4be4f4c99c6869378d161c2/users/efd6bfbfa0ef435ba141895cca6d866e/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:35.145002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ef93c-3948-4391-bf3a-c1b5b9d9b51a None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.145294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ef93c-3948-4391-bf3a-c1b5b9d9b51a None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.145573 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ef93c-3948-4391-bf3a-c1b5b9d9b51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.171221 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-fe1ef93c-3948-4391-bf3a-c1b5b9d9b51a None None] MFA Rules not processed for user `efd6bfbfa0ef435ba141895cca6d866e`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:35.172461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-fe1ef93c-3948-4391-bf3a-c1b5b9d9b51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:35.234838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1353/2675] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:35.239750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b48ec8-637d-41dc-8ea8-4b6e40befe43 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.301577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b48ec8-637d-41dc-8ea8-4b6e40befe43 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.306265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30c7eb-a904-47e0-b9a2-6e8827158320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.306915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30c7eb-a904-47e0-b9a2-6e8827158320 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.307201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30c7eb-a904-47e0-b9a2-6e8827158320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.307477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30c7eb-a904-47e0-b9a2-6e8827158320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.308156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30c7eb-a904-47e0-b9a2-6e8827158320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.310111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f30c7eb-a904-47e0-b9a2-6e8827158320 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.334713 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1323/2676] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:35 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:35.338895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ef93c-3948-4391-bf3a-c1b5b9d9b51a None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.349877 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ef93c-3948-4391-bf3a-c1b5b9d9b51a None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.375490 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:35.407073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac13da-471e-4d8a-a2f2-dcf47e95d518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.407728 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac13da-471e-4d8a-a2f2-dcf47e95d518 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.408011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac13da-471e-4d8a-a2f2-dcf47e95d518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.408288 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac13da-471e-4d8a-a2f2-dcf47e95d518 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.409001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac13da-471e-4d8a-a2f2-dcf47e95d518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.410911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac13da-471e-4d8a-a2f2-dcf47e95d518 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.431538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1354/2677] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:35 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:35.435468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30c7eb-a904-47e0-b9a2-6e8827158320 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.445856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30c7eb-a904-47e0-b9a2-6e8827158320 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.450504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c9ea0-2a35-4742-9642-9e00ffb5dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.451160 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c9ea0-2a35-4742-9642-9e00ffb5dcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.451445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c9ea0-2a35-4742-9642-9e00ffb5dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.451725 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c9ea0-2a35-4742-9642-9e00ffb5dcc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.452513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c9ea0-2a35-4742-9642-9e00ffb5dcc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.454760 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c9ea0-2a35-4742-9642-9e00ffb5dcc8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.466585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1324/2678] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:35.471450 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac13da-471e-4d8a-a2f2-dcf47e95d518 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.481469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac13da-471e-4d8a-a2f2-dcf47e95d518 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.486345 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4db8b-c425-4abc-a340-b0b1baf19ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.487254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4db8b-c425-4abc-a340-b0b1baf19ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.487543 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4db8b-c425-4abc-a340-b0b1baf19ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.487824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4db8b-c425-4abc-a340-b0b1baf19ef4 admin admin] PATH_INFO: `/v3/projects/877ad1c963004de9978c252d47d49f04/users/01d775a24a8f4897aba17ce3bd906ac3/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.502494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4db8b-c425-4abc-a340-b0b1baf19ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877ad1c963004de9978c252d47d49f04, user_id=01d775a24a8f4897aba17ce3bd906ac3, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.505197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4db8b-c425-4abc-a340-b0b1baf19ef4 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.518533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1355/2679] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:35 2022] PUT /identity/v3/projects/877ad1c963004de9978c252d47d49f04/users/01d775a24a8f4897aba17ce3bd906ac3/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:35.522520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c9ea0-2a35-4742-9642-9e00ffb5dcc8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.533046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c9ea0-2a35-4742-9642-9e00ffb5dcc8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.589113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939b6c0-aa93-4591-b7b7-db189b29b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.589800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b6c0-aa93-4591-b7b7-db189b29b8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.590083 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b6c0-aa93-4591-b7b7-db189b29b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.590551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b6c0-aa93-4591-b7b7-db189b29b8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.591255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b6c0-aa93-4591-b7b7-db189b29b8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.592875 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b6c0-aa93-4591-b7b7-db189b29b8e8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.603524 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1325/2680] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:35.607636 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4db8b-c425-4abc-a340-b0b1baf19ef4 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.618000 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4db8b-c425-4abc-a340-b0b1baf19ef4 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.622552 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8be714-083d-446c-94c0-764cd098057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.623423 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8be714-083d-446c-94c0-764cd098057d admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.623705 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8be714-083d-446c-94c0-764cd098057d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.623981 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8be714-083d-446c-94c0-764cd098057d admin admin] PATH_INFO: `/v3/projects/877ad1c963004de9978c252d47d49f04/users/01d775a24a8f4897aba17ce3bd906ac3/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.626468 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8be714-083d-446c-94c0-764cd098057d admin admin] RBAC: Authorizing `identity:create_grant(project_id=877ad1c963004de9978c252d47d49f04, user_id=01d775a24a8f4897aba17ce3bd906ac3, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.629354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8be714-083d-446c-94c0-764cd098057d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.642082 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1356/2681] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:35 2022] PUT /identity/v3/projects/877ad1c963004de9978c252d47d49f04/users/01d775a24a8f4897aba17ce3bd906ac3/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:35.652303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417c9e3-92d4-47c8-b74e-d124f307684e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.652632 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417c9e3-92d4-47c8-b74e-d124f307684e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.652907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417c9e3-92d4-47c8-b74e-d124f307684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.680376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d417c9e3-92d4-47c8-b74e-d124f307684e None None] MFA Rules not processed for user `01d775a24a8f4897aba17ce3bd906ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:35.681584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d417c9e3-92d4-47c8-b74e-d124f307684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:35.693099 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:35.751787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1326/2682] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:35.763155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8be714-083d-446c-94c0-764cd098057d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.764987 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3e8be714-083d-446c-94c0-764cd098057d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:35.822740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8be714-083d-446c-94c0-764cd098057d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.826427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7badb26-5fec-444f-aee4-e50ef069d50b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.827058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7badb26-5fec-444f-aee4-e50ef069d50b service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.827340 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7badb26-5fec-444f-aee4-e50ef069d50b service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.827619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7badb26-5fec-444f-aee4-e50ef069d50b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.836443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7badb26-5fec-444f-aee4-e50ef069d50b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.837860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7badb26-5fec-444f-aee4-e50ef069d50b service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.848034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1357/2683] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:35.890173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417c9e3-92d4-47c8-b74e-d124f307684e None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:35.891818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d417c9e3-92d4-47c8-b74e-d124f307684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:35.903855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417c9e3-92d4-47c8-b74e-d124f307684e None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:35.907973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94617030-9141-4edd-9aae-a3a9be25b438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:35.908644 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94617030-9141-4edd-9aae-a3a9be25b438 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:35.908932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94617030-9141-4edd-9aae-a3a9be25b438 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:35.909208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94617030-9141-4edd-9aae-a3a9be25b438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:35.965222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94617030-9141-4edd-9aae-a3a9be25b438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:35.966662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94617030-9141-4edd-9aae-a3a9be25b438 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:35.976188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1327/2684] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:37.434999 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6dd41-f0fa-4b67-9c1a-dc632d3a03cd None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:37.435493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6dd41-f0fa-4b67-9c1a-dc632d3a03cd None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:37.435792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6dd41-f0fa-4b67-9c1a-dc632d3a03cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:37.461522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-65e6dd41-f0fa-4b67-9c1a-dc632d3a03cd None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:37.462766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-65e6dd41-f0fa-4b67-9c1a-dc632d3a03cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:37.526260 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1358/2685] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jun 20 06:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:37.563025 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94617030-9141-4edd-9aae-a3a9be25b438 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:37.565059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-94617030-9141-4edd-9aae-a3a9be25b438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:37.642985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94617030-9141-4edd-9aae-a3a9be25b438 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:37.649972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2977fc-d71f-4bc6-9f49-c5b244cda0f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:37.650747 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2977fc-d71f-4bc6-9f49-c5b244cda0f3 service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:37.651156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2977fc-d71f-4bc6-9f49-c5b244cda0f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:37.651498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2977fc-d71f-4bc6-9f49-c5b244cda0f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:37.664540 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2977fc-d71f-4bc6-9f49-c5b244cda0f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:37.666187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2977fc-d71f-4bc6-9f49-c5b244cda0f3 service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:37.676710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1328/2686] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:39.276970 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6dd41-f0fa-4b67-9c1a-dc632d3a03cd None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:39.286958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6dd41-f0fa-4b67-9c1a-dc632d3a03cd None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:39.291594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:39.292488 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.292778 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.293060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] PATH_INFO: `/v3/users/efd6bfbfa0ef435ba141895cca6d866e` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.294259 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd6bfbfa0ef435ba141895cca6d866e)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:39.296182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:39.318396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:39.343461 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd6bfbfa0ef435ba141895cca6d866e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.350780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd6bfbfa0ef435ba141895cca6d866e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.352426 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd6bfbfa0ef435ba141895cca6d866e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.353049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd6bfbfa0ef435ba141895cca6d866e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.365440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd6bfbfa0ef435ba141895cca6d866e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.382307 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1359/2687] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:39 2022] DELETE /identity/v3/users/efd6bfbfa0ef435ba141895cca6d866e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:39.386681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec7515-3b92-473a-82ef-2ccb54b95ee5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.387137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec7515-3b92-473a-82ef-2ccb54b95ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.387252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec7515-3b92-473a-82ef-2ccb54b95ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.405013 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c4ec7515-3b92-473a-82ef-2ccb54b95ee5 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:39.406212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c4ec7515-3b92-473a-82ef-2ccb54b95ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:39.439117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:39.469100 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1329/2688] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:39.478718 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:39.480138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:39.542244 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44920abf-9ce0-49ec-9639-f24fac114e3a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:39.545838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a43f-04a6-460b-8124-748799b6a51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:39.546486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a43f-04a6-460b-8124-748799b6a51f service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.546762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a43f-04a6-460b-8124-748799b6a51f service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.547036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44a43f-04a6-460b-8124-748799b6a51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.556040 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44a43f-04a6-460b-8124-748799b6a51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:39.557508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44a43f-04a6-460b-8124-748799b6a51f service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:39.567495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1360/2689] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:39.837058 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec7515-3b92-473a-82ef-2ccb54b95ee5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:39.838588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c4ec7515-3b92-473a-82ef-2ccb54b95ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:39.850928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec7515-3b92-473a-82ef-2ccb54b95ee5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:39.856282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:39.857337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:39.857620 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:39.857894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] PATH_INFO: `/v3/projects/52cab571f4be4f4c99c6869378d161c2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:39.860789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cab571f4be4f4c99c6869378d161c2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:39.863377 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:39.911545 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cab571f4be4f4c99c6869378d161c2', 'request_id': 'req-713414f2-e6aa-4c9e-9825-21b81d160221'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.917004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cab571f4be4f4c99c6869378d161c2', 'request_id': 'req-713414f2-e6aa-4c9e-9825-21b81d160221'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.925159 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cab571f4be4f4c99c6869378d161c2', 'request_id': 'req-713414f2-e6aa-4c9e-9825-21b81d160221'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.936361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] The token cache is being invalidate because project 52cab571f4be4f4c99c6869378d161c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:39.936649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.937275 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:39.939363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1330/2690] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:39 2022] DELETE /identity/v3/projects/52cab571f4be4f4c99c6869378d161c2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:39.944071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a43f-04a6-460b-8124-748799b6a51f service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:39.953858 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44a43f-04a6-460b-8124-748799b6a51f service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.008278 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d3b2e-5c95-4b84-a230-319b0dd87d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.009159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3b2e-5c95-4b84-a230-319b0dd87d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.009443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3b2e-5c95-4b84-a230-319b0dd87d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.009720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d3b2e-5c95-4b84-a230-319b0dd87d48 admin admin] PATH_INFO: `/v3/users/01d775a24a8f4897aba17ce3bd906ac3` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.010895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d3b2e-5c95-4b84-a230-319b0dd87d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d775a24a8f4897aba17ce3bd906ac3)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.012873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d3b2e-5c95-4b84-a230-319b0dd87d48 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.052928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:40.058501 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ba2d3b2e-5c95-4b84-a230-319b0dd87d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d775a24a8f4897aba17ce3bd906ac3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.066197 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ba2d3b2e-5c95-4b84-a230-319b0dd87d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d775a24a8f4897aba17ce3bd906ac3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.066852 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ba2d3b2e-5c95-4b84-a230-319b0dd87d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d775a24a8f4897aba17ce3bd906ac3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.067455 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ba2d3b2e-5c95-4b84-a230-319b0dd87d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d775a24a8f4897aba17ce3bd906ac3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.079857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ba2d3b2e-5c95-4b84-a230-319b0dd87d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d775a24a8f4897aba17ce3bd906ac3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.093457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1361/2691] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:39 2022] DELETE /identity/v3/users/01d775a24a8f4897aba17ce3bd906ac3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:40.360825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.362294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:40.376662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713414f2-e6aa-4c9e-9825-21b81d160221 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.436305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.437185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.437469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.437745 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] PATH_INFO: `/v3/projects/877ad1c963004de9978c252d47d49f04` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.439465 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=877ad1c963004de9978c252d47d49f04)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.441440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.492365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877ad1c963004de9978c252d47d49f04', 'request_id': 'req-1254bf51-3543-4862-953f-148995b913c2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.497756 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877ad1c963004de9978c252d47d49f04', 'request_id': 'req-1254bf51-3543-4862-953f-148995b913c2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.499381 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:40.507666 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877ad1c963004de9978c252d47d49f04', 'request_id': 'req-1254bf51-3543-4862-953f-148995b913c2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.512026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521ab9-82f1-411d-b8c1-91ab9b8b4e2d None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.512510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521ab9-82f1-411d-b8c1-91ab9b8b4e2d None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.512626 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521ab9-82f1-411d-b8c1-91ab9b8b4e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.519740 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] The token cache is being invalidate because project 877ad1c963004de9978c252d47d49f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:40.520030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.520694 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-1254bf51-3543-4862-953f-148995b913c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:40.522445 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1331/2692] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:40 2022] DELETE /identity/v3/projects/877ad1c963004de9978c252d47d49f04 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:40.527089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306a068-099a-439f-9d3f-8ae0f76c68d7 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.527534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306a068-099a-439f-9d3f-8ae0f76c68d7 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.527816 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306a068-099a-439f-9d3f-8ae0f76c68d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.531118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-55521ab9-82f1-411d-b8c1-91ab9b8b4e2d None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:40.532403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-55521ab9-82f1-411d-b8c1-91ab9b8b4e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:40.545909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-1306a068-099a-439f-9d3f-8ae0f76c68d7 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:40.547087 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1306a068-099a-439f-9d3f-8ae0f76c68d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:40.591877 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1362/2693] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jun 20 06:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:40.606684 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1332/2694] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:40.614914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6822-7959-43c9-aaff-00d520f621f6 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.615214 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6822-7959-43c9-aaff-00d520f621f6 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.615495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6822-7959-43c9-aaff-00d520f621f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.616092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306a068-099a-439f-9d3f-8ae0f76c68d7 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.617573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-1306a068-099a-439f-9d3f-8ae0f76c68d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:40.633784 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-07ce6822-7959-43c9-aaff-00d520f621f6 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:40.634960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-07ce6822-7959-43c9-aaff-00d520f621f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:40.643297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1363/2695] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:40.647799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6822-7959-43c9-aaff-00d520f621f6 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.657075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6822-7959-43c9-aaff-00d520f621f6 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.661726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e49212-abab-43a5-bba1-735fdfedcc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.662369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e49212-abab-43a5-bba1-735fdfedcc1d admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.662657 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e49212-abab-43a5-bba1-735fdfedcc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.662936 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e49212-abab-43a5-bba1-735fdfedcc1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.663690 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e49212-abab-43a5-bba1-735fdfedcc1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:40.664001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e49212-abab-43a5-bba1-735fdfedcc1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.665676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e49212-abab-43a5-bba1-735fdfedcc1d admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.677922 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1364/2696] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:14:40.682180 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e49212-abab-43a5-bba1-735fdfedcc1d admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.692208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e49212-abab-43a5-bba1-735fdfedcc1d admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.696988 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4a77c-341d-4cef-adeb-3bd2cfac890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.697394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306a068-099a-439f-9d3f-8ae0f76c68d7 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.697649 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4a77c-341d-4cef-adeb-3bd2cfac890a admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.697956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4a77c-341d-4cef-adeb-3bd2cfac890a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.698322 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4a77c-341d-4cef-adeb-3bd2cfac890a admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.699136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4a77c-341d-4cef-adeb-3bd2cfac890a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.701070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4a77c-341d-4cef-adeb-3bd2cfac890a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.703185 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389030b1-b341-463c-bda6-4b4419837eff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.704359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389030b1-b341-463c-bda6-4b4419837eff service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.704654 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389030b1-b341-463c-bda6-4b4419837eff service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.704932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389030b1-b341-463c-bda6-4b4419837eff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.713546 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389030b1-b341-463c-bda6-4b4419837eff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.715126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389030b1-b341-463c-bda6-4b4419837eff service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.725707 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1333/2697] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:40.730371 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1365/2698] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:40 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:40.737285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389030b1-b341-463c-bda6-4b4419837eff service nova] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.748279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389030b1-b341-463c-bda6-4b4419837eff service nova] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.807701 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfa3c8-9b1e-4836-875b-ab1bfdb178b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.808409 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfa3c8-9b1e-4836-875b-ab1bfdb178b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.808699 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfa3c8-9b1e-4836-875b-ab1bfdb178b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.808981 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfa3c8-9b1e-4836-875b-ab1bfdb178b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.809704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfa3c8-9b1e-4836-875b-ab1bfdb178b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.811629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfa3c8-9b1e-4836-875b-ab1bfdb178b2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.833469 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1334/2699] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:40 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:40.837744 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4a77c-341d-4cef-adeb-3bd2cfac890a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.849066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4a77c-341d-4cef-adeb-3bd2cfac890a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.853666 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538f41a-1f6a-46b2-bc3b-484017514635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.854319 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538f41a-1f6a-46b2-bc3b-484017514635 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.854628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538f41a-1f6a-46b2-bc3b-484017514635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.854907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538f41a-1f6a-46b2-bc3b-484017514635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.855630 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538f41a-1f6a-46b2-bc3b-484017514635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.857310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538f41a-1f6a-46b2-bc3b-484017514635 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.867607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1366/2700] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:40.871375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfa3c8-9b1e-4836-875b-ab1bfdb178b2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.876951 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:40.883309 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfa3c8-9b1e-4836-875b-ab1bfdb178b2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.888919 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd90c9-d3e0-4d46-8d70-e4a049ca1fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.889622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd90c9-d3e0-4d46-8d70-e4a049ca1fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.889907 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd90c9-d3e0-4d46-8d70-e4a049ca1fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.890189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd90c9-d3e0-4d46-8d70-e4a049ca1fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.890915 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd90c9-d3e0-4d46-8d70-e4a049ca1fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.892802 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd90c9-d3e0-4d46-8d70-e4a049ca1fe5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.902769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1335/2701] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:40.907409 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538f41a-1f6a-46b2-bc3b-484017514635 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:40.917643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538f41a-1f6a-46b2-bc3b-484017514635 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:40.922241 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b27d8-2670-4387-94d3-e7cd4bd3965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:40.923682 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b27d8-2670-4387-94d3-e7cd4bd3965b admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.923965 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b27d8-2670-4387-94d3-e7cd4bd3965b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.924271 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b27d8-2670-4387-94d3-e7cd4bd3965b admin admin] PATH_INFO: `/v3/projects/25e853c228f2400a8f3388e2f8a431d0/users/dc71983eccca4146aec900905b7d7abe/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.938900 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b27d8-2670-4387-94d3-e7cd4bd3965b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e853c228f2400a8f3388e2f8a431d0, user_id=dc71983eccca4146aec900905b7d7abe, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:40.941599 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b27d8-2670-4387-94d3-e7cd4bd3965b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:40.955031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1367/2702] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:40 2022] PUT /identity/v3/projects/25e853c228f2400a8f3388e2f8a431d0/users/dc71983eccca4146aec900905b7d7abe/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:40.966093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30fac2-2b7b-4c23-ad68-6a54161a06b9 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:40.966387 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30fac2-2b7b-4c23-ad68-6a54161a06b9 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:40.966665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30fac2-2b7b-4c23-ad68-6a54161a06b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:40.992963 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ff30fac2-2b7b-4c23-ad68-6a54161a06b9 None None] MFA Rules not processed for user `dc71983eccca4146aec900905b7d7abe`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:40.994298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ff30fac2-2b7b-4c23-ad68-6a54161a06b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:41.057252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1336/2703] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:41.061709 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b27d8-2670-4387-94d3-e7cd4bd3965b admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.105995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:41.124056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b27d8-2670-4387-94d3-e7cd4bd3965b admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.129146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d63553-58e9-4e08-a47d-c386b2deca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.129822 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d63553-58e9-4e08-a47d-c386b2deca42 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.130109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d63553-58e9-4e08-a47d-c386b2deca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.130387 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d63553-58e9-4e08-a47d-c386b2deca42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.131085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d63553-58e9-4e08-a47d-c386b2deca42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.133031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d63553-58e9-4e08-a47d-c386b2deca42 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.157792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1368/2704] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:41 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:41.161855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30fac2-2b7b-4c23-ad68-6a54161a06b9 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.173211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30fac2-2b7b-4c23-ad68-6a54161a06b9 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.228938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729efdd-fccb-4dc4-b626-8b1d2d524dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.229604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729efdd-fccb-4dc4-b626-8b1d2d524dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.229895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729efdd-fccb-4dc4-b626-8b1d2d524dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.230174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729efdd-fccb-4dc4-b626-8b1d2d524dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.230857 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729efdd-fccb-4dc4-b626-8b1d2d524dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.232911 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729efdd-fccb-4dc4-b626-8b1d2d524dd3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.252925 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1337/2705] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:41 2022] POST /identity/v3/users => generated 306 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:41.256918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d63553-58e9-4e08-a47d-c386b2deca42 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.267928 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d63553-58e9-4e08-a47d-c386b2deca42 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.272596 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c17f3-1ec3-47eb-a6c3-a1f240a7696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.273248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c17f3-1ec3-47eb-a6c3-a1f240a7696b admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.273538 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c17f3-1ec3-47eb-a6c3-a1f240a7696b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.273817 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c17f3-1ec3-47eb-a6c3-a1f240a7696b admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.274547 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c17f3-1ec3-47eb-a6c3-a1f240a7696b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.276149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c17f3-1ec3-47eb-a6c3-a1f240a7696b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.286963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1369/2706] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:41.290937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729efdd-fccb-4dc4-b626-8b1d2d524dd3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.300933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729efdd-fccb-4dc4-b626-8b1d2d524dd3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.305598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a137de5-d257-4ff2-a89c-58864a079ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.306495 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137de5-d257-4ff2-a89c-58864a079ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.306777 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137de5-d257-4ff2-a89c-58864a079ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.307053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a137de5-d257-4ff2-a89c-58864a079ffd admin admin] PATH_INFO: `/v3/projects/57c001ea6fcb4252b038cddb9f32983b/users/2476717597b14970887354dc4cba2956/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.321454 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a137de5-d257-4ff2-a89c-58864a079ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c001ea6fcb4252b038cddb9f32983b, user_id=2476717597b14970887354dc4cba2956, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.324104 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a137de5-d257-4ff2-a89c-58864a079ffd admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.337273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1338/2707] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:41 2022] PUT /identity/v3/projects/57c001ea6fcb4252b038cddb9f32983b/users/2476717597b14970887354dc4cba2956/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:41.341225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c17f3-1ec3-47eb-a6c3-a1f240a7696b admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.351683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c17f3-1ec3-47eb-a6c3-a1f240a7696b admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.407582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114a612-a009-4bc6-b983-42e46e6f7111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.408152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a612-a009-4bc6-b983-42e46e6f7111 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.408476 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a612-a009-4bc6-b983-42e46e6f7111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.408757 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a612-a009-4bc6-b983-42e46e6f7111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.409510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114a612-a009-4bc6-b983-42e46e6f7111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.411149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114a612-a009-4bc6-b983-42e46e6f7111 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.420777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1370/2708] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:41.425068 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a137de5-d257-4ff2-a89c-58864a079ffd admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.435348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a137de5-d257-4ff2-a89c-58864a079ffd admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.440030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109e5ba-89d4-4873-94d6-c3e92385dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.440947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109e5ba-89d4-4873-94d6-c3e92385dd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.441233 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109e5ba-89d4-4873-94d6-c3e92385dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.441513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109e5ba-89d4-4873-94d6-c3e92385dd27 admin admin] PATH_INFO: `/v3/projects/57c001ea6fcb4252b038cddb9f32983b/users/2476717597b14970887354dc4cba2956/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.443485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109e5ba-89d4-4873-94d6-c3e92385dd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c001ea6fcb4252b038cddb9f32983b, user_id=2476717597b14970887354dc4cba2956, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.446180 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109e5ba-89d4-4873-94d6-c3e92385dd27 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.457257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1339/2709] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:41 2022] PUT /identity/v3/projects/57c001ea6fcb4252b038cddb9f32983b/users/2476717597b14970887354dc4cba2956/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:41.467460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d82c7-9513-4b1a-bb90-6be90aa514e8 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.467748 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d82c7-9513-4b1a-bb90-6be90aa514e8 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.468055 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d82c7-9513-4b1a-bb90-6be90aa514e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.494111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-924d82c7-9513-4b1a-bb90-6be90aa514e8 None None] MFA Rules not processed for user `2476717597b14970887354dc4cba2956`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:41.495594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-924d82c7-9513-4b1a-bb90-6be90aa514e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:41.563057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1371/2710] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:41.573528 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109e5ba-89d4-4873-94d6-c3e92385dd27 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.575220 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a109e5ba-89d4-4873-94d6-c3e92385dd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:41.611051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:41.634574 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109e5ba-89d4-4873-94d6-c3e92385dd27 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.638305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae65a13-3c85-4879-8e67-25f0d92c6494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.638934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae65a13-3c85-4879-8e67-25f0d92c6494 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.639212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae65a13-3c85-4879-8e67-25f0d92c6494 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.639485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae65a13-3c85-4879-8e67-25f0d92c6494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.649247 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae65a13-3c85-4879-8e67-25f0d92c6494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.650774 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae65a13-3c85-4879-8e67-25f0d92c6494 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.660385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1340/2711] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:41.729725 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d82c7-9513-4b1a-bb90-6be90aa514e8 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:41.739327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d82c7-9513-4b1a-bb90-6be90aa514e8 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:41.742978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e510380-f765-4206-8a17-d4843e422510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:41.743611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510380-f765-4206-8a17-d4843e422510 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:41.743897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510380-f765-4206-8a17-d4843e422510 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:41.744174 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510380-f765-4206-8a17-d4843e422510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:41.777176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:41.800813 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e510380-f765-4206-8a17-d4843e422510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:41.802262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e510380-f765-4206-8a17-d4843e422510 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:41.811306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1372/2712] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:43.673936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401e23-8b4e-41de-9be6-122dcab7614d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:43.674427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401e23-8b4e-41de-9be6-122dcab7614d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:43.674534 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6401e23-8b4e-41de-9be6-122dcab7614d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:43.692289 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d6401e23-8b4e-41de-9be6-122dcab7614d None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:43.693710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d6401e23-8b4e-41de-9be6-122dcab7614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:43.753201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1341/2713] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jun 20 06:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:43.791049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e510380-f765-4206-8a17-d4843e422510 service cinder] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:43.792597 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-3e510380-f765-4206-8a17-d4843e422510 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:43.863670 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e510380-f765-4206-8a17-d4843e422510 service cinder] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:43.869095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26561a-d9f0-4ffa-a429-fd8a1ddcb754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:43.869731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26561a-d9f0-4ffa-a429-fd8a1ddcb754 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:43.870022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26561a-d9f0-4ffa-a429-fd8a1ddcb754 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:43.870297 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26561a-d9f0-4ffa-a429-fd8a1ddcb754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:43.878765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26561a-d9f0-4ffa-a429-fd8a1ddcb754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:43.880355 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26561a-d9f0-4ffa-a429-fd8a1ddcb754 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:43.889632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1373/2714] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:45.823448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6401e23-8b4e-41de-9be6-122dcab7614d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:45.834634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6401e23-8b4e-41de-9be6-122dcab7614d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:45.839046 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:45.839895 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:45.840174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:45.840478 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] PATH_INFO: `/v3/users/dc71983eccca4146aec900905b7d7abe` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:45.841682 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc71983eccca4146aec900905b7d7abe)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:45.843590 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:45.893488 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc71983eccca4146aec900905b7d7abe'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.894239 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc71983eccca4146aec900905b7d7abe'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.901092 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc71983eccca4146aec900905b7d7abe'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.908548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc71983eccca4146aec900905b7d7abe'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.909173 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc71983eccca4146aec900905b7d7abe'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:45.926316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1342/2715] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:45 2022] DELETE /identity/v3/users/dc71983eccca4146aec900905b7d7abe => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:45.930845 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a90e12-f640-49f3-9f36-e745fdb86a34 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:45.931356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a90e12-f640-49f3-9f36-e745fdb86a34 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:45.931457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a90e12-f640-49f3-9f36-e745fdb86a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:45.948111 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-14a90e12-f640-49f3-9f36-e745fdb86a34 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:45.949387 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-14a90e12-f640-49f3-9f36-e745fdb86a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:46.007882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1374/2716] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:46.017839 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:46.019296 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:46.074497 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:46.085735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aada32-402d-466b-bac1-104c20740ff0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:46.093191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317f15-54fa-42d0-8f58-4aae4bd122f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:46.094054 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317f15-54fa-42d0-8f58-4aae4bd122f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:46.096980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317f15-54fa-42d0-8f58-4aae4bd122f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:46.096980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317f15-54fa-42d0-8f58-4aae4bd122f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:46.108604 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48317f15-54fa-42d0-8f58-4aae4bd122f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:46.110464 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48317f15-54fa-42d0-8f58-4aae4bd122f5 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:46.121366 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1343/2717] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:46.397247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a90e12-f640-49f3-9f36-e745fdb86a34 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:46.398701 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-14a90e12-f640-49f3-9f36-e745fdb86a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:46.410941 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a90e12-f640-49f3-9f36-e745fdb86a34 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:46.415619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:46.416511 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:46.416794 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:46.417070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] PATH_INFO: `/v3/projects/25e853c228f2400a8f3388e2f8a431d0` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:46.418254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e853c228f2400a8f3388e2f8a431d0)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:46.420244 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:46.469186 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e853c228f2400a8f3388e2f8a431d0', 'request_id': 'req-211ddd2b-928f-4ceb-8562-30255bc93787'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.473716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:46.474909 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e853c228f2400a8f3388e2f8a431d0', 'request_id': 'req-211ddd2b-928f-4ceb-8562-30255bc93787'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.482426 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e853c228f2400a8f3388e2f8a431d0', 'request_id': 'req-211ddd2b-928f-4ceb-8562-30255bc93787'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.494675 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] The token cache is being invalidate because project 25e853c228f2400a8f3388e2f8a431d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:46.494969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.495611 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-211ddd2b-928f-4ceb-8562-30255bc93787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.497174 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1375/2718] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:46 2022] DELETE /identity/v3/projects/25e853c228f2400a8f3388e2f8a431d0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:46.501661 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317f15-54fa-42d0-8f58-4aae4bd122f5 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:46.511277 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317f15-54fa-42d0-8f58-4aae4bd122f5 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:46.567248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:46.568061 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:46.568369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:46.568652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] PATH_INFO: `/v3/users/2476717597b14970887354dc4cba2956` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:46.569835 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] RBAC: Authorizing `identity:delete_user(user_id=2476717597b14970887354dc4cba2956)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:46.571751 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:46.616702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2476717597b14970887354dc4cba2956'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.617347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2476717597b14970887354dc4cba2956'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.623941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2476717597b14970887354dc4cba2956'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.631708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2476717597b14970887354dc4cba2956'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.632356 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2476717597b14970887354dc4cba2956'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:46.650373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1344/2719] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:46 2022] DELETE /identity/v3/users/2476717597b14970887354dc4cba2956 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:46.839282 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f3fe-f73a-4c81-be4f-4d818bc147c4 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:46.839545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f3fe-f73a-4c81-be4f-4d818bc147c4 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:46.839827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f3fe-f73a-4c81-be4f-4d818bc147c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:46.858956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-5b62f3fe-f73a-4c81-be4f-4d818bc147c4 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:46.860264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5b62f3fe-f73a-4c81-be4f-4d818bc147c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:46.924148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1376/2720] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jun 20 06:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:46.933284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:46.934824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:46.949595 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f3fe-f73a-4c81-be4f-4d818bc147c4 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:46.951164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-5b62f3fe-f73a-4c81-be4f-4d818bc147c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:46.959385 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c86b7-88f2-4f6d-9087-d8fddef606df admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:46.964298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:46.965120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:46.965402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:46.965679 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] PATH_INFO: `/v3/projects/57c001ea6fcb4252b038cddb9f32983b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:46.966865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c001ea6fcb4252b038cddb9f32983b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:46.968838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.018191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c001ea6fcb4252b038cddb9f32983b', 'request_id': 'req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:47.023708 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c001ea6fcb4252b038cddb9f32983b', 'request_id': 'req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:47.031076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c001ea6fcb4252b038cddb9f32983b', 'request_id': 'req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:47.031493 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f3fe-f73a-4c81-be4f-4d818bc147c4 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.032475 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:47.044876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] The token cache is being invalidate because project 57c001ea6fcb4252b038cddb9f32983b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:47.045161 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:47.045844 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ce2ac42b-4ed5-4a04-b174-55b415df3ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:47.047515 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1345/2721] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:46 2022] DELETE /identity/v3/projects/57c001ea6fcb4252b038cddb9f32983b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:47.052159 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81bbe8-95d1-48f8-b358-0c57dce5d92b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.052482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81bbe8-95d1-48f8-b358-0c57dce5d92b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.052767 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81bbe8-95d1-48f8-b358-0c57dce5d92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.071395 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4b81bbe8-95d1-48f8-b358-0c57dce5d92b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:47.072631 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4b81bbe8-95d1-48f8-b358-0c57dce5d92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:47.100162 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a33f1c-e75f-4b88-b9d0-c11304abdf5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.100803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a33f1c-e75f-4b88-b9d0-c11304abdf5c service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.101096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a33f1c-e75f-4b88-b9d0-c11304abdf5c service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.101372 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a33f1c-e75f-4b88-b9d0-c11304abdf5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.103153 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a2a33f1c-e75f-4b88-b9d0-c11304abdf5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:47.124525 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:47.134963 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1346/2722] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:47.143978 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5467e44-326f-40b8-8228-3a240ac8330f None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.144272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5467e44-326f-40b8-8228-3a240ac8330f None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.144585 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5467e44-326f-40b8-8228-3a240ac8330f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.162888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c5467e44-326f-40b8-8228-3a240ac8330f None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:47.164112 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c5467e44-326f-40b8-8228-3a240ac8330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:47.171569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a33f1c-e75f-4b88-b9d0-c11304abdf5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.172607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1347/2723] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:47.173199 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a33f1c-e75f-4b88-b9d0-c11304abdf5c service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.176485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5467e44-326f-40b8-8228-3a240ac8330f None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:47.183067 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1377/2724] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:47.186169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5467e44-326f-40b8-8228-3a240ac8330f None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.191522 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf269ca8-0a7c-400b-b6f7-44cca5dce9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.192090 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf269ca8-0a7c-400b-b6f7-44cca5dce9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.192304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf269ca8-0a7c-400b-b6f7-44cca5dce9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.192607 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf269ca8-0a7c-400b-b6f7-44cca5dce9a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.193499 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf269ca8-0a7c-400b-b6f7-44cca5dce9a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:47.193617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf269ca8-0a7c-400b-b6f7-44cca5dce9a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.195290 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf269ca8-0a7c-400b-b6f7-44cca5dce9a5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.209082 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1348/2725] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:14:47.214563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a33f1c-e75f-4b88-b9d0-c11304abdf5c service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:47.224338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a33f1c-e75f-4b88-b9d0-c11304abdf5c service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.229973 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd93f76-645c-46b3-b4b3-b2b091f35b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.230691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd93f76-645c-46b3-b4b3-b2b091f35b7f admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.230979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd93f76-645c-46b3-b4b3-b2b091f35b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.231254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd93f76-645c-46b3-b4b3-b2b091f35b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.231986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd93f76-645c-46b3-b4b3-b2b091f35b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.233891 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd93f76-645c-46b3-b4b3-b2b091f35b7f admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.262677 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1378/2726] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:47 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:47.266886 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf269ca8-0a7c-400b-b6f7-44cca5dce9a5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:47.277761 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf269ca8-0a7c-400b-b6f7-44cca5dce9a5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.341303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad384d-df3a-43f9-b217-cb92ee559c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.342062 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad384d-df3a-43f9-b217-cb92ee559c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.342258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad384d-df3a-43f9-b217-cb92ee559c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.342530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad384d-df3a-43f9-b217-cb92ee559c8d admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.343213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad384d-df3a-43f9-b217-cb92ee559c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.345216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad384d-df3a-43f9-b217-cb92ee559c8d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.366423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1349/2727] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:47 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:47.370724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd93f76-645c-46b3-b4b3-b2b091f35b7f admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:47.381680 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd93f76-645c-46b3-b4b3-b2b091f35b7f admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.386488 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b28a9-8ff0-478c-872f-7ce36f3c584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.387116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b28a9-8ff0-478c-872f-7ce36f3c584b admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.387396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b28a9-8ff0-478c-872f-7ce36f3c584b admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.387669 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b28a9-8ff0-478c-872f-7ce36f3c584b admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.388425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b28a9-8ff0-478c-872f-7ce36f3c584b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.390005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b28a9-8ff0-478c-872f-7ce36f3c584b admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.403069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1379/2728] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:47.407189 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad384d-df3a-43f9-b217-cb92ee559c8d admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:47.417613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad384d-df3a-43f9-b217-cb92ee559c8d admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.424284 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f87e34-ab08-4558-9007-7662c6b24c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.425063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f87e34-ab08-4558-9007-7662c6b24c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.425497 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f87e34-ab08-4558-9007-7662c6b24c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.425840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f87e34-ab08-4558-9007-7662c6b24c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.426634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f87e34-ab08-4558-9007-7662c6b24c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.428350 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f87e34-ab08-4558-9007-7662c6b24c03 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.446376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1350/2729] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:47.447404 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b28a9-8ff0-478c-872f-7ce36f3c584b admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:47.458343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b28a9-8ff0-478c-872f-7ce36f3c584b admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.463096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8290ba9-0d8e-46d3-b624-bc2e68f96e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.463975 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8290ba9-0d8e-46d3-b624-bc2e68f96e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.464256 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8290ba9-0d8e-46d3-b624-bc2e68f96e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.464567 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8290ba9-0d8e-46d3-b624-bc2e68f96e61 admin admin] PATH_INFO: `/v3/projects/88638b4fd1af453ab2fcb1863ea070fd/users/a02046f56a6a43e79171bd737b7d3113/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.479762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8290ba9-0d8e-46d3-b624-bc2e68f96e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88638b4fd1af453ab2fcb1863ea070fd, user_id=a02046f56a6a43e79171bd737b7d3113, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.482419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8290ba9-0d8e-46d3-b624-bc2e68f96e61 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.506056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1380/2730] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:47 2022] PUT /identity/v3/projects/88638b4fd1af453ab2fcb1863ea070fd/users/a02046f56a6a43e79171bd737b7d3113/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:47.517504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51028-2c4e-4288-926d-534237f0d7d2 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.517869 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51028-2c4e-4288-926d-534237f0d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.518212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51028-2c4e-4288-926d-534237f0d7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.545711 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-b2a51028-2c4e-4288-926d-534237f0d7d2 None None] MFA Rules not processed for user `a02046f56a6a43e79171bd737b7d3113`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:47.546906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b2a51028-2c4e-4288-926d-534237f0d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:47.589227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:47.613398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1351/2731] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:47.617780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8290ba9-0d8e-46d3-b624-bc2e68f96e61 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:47.677935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8290ba9-0d8e-46d3-b624-bc2e68f96e61 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.682514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ce2d-ae79-408a-bdce-f04d859183cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.683155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ce2d-ae79-408a-bdce-f04d859183cb admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.683504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ce2d-ae79-408a-bdce-f04d859183cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.683713 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ce2d-ae79-408a-bdce-f04d859183cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.684440 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3ce2d-ae79-408a-bdce-f04d859183cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.686324 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3ce2d-ae79-408a-bdce-f04d859183cb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.710874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1381/2732] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:47 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:47.714730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a51028-2c4e-4288-926d-534237f0d7d2 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:47.726267 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a51028-2c4e-4288-926d-534237f0d7d2 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.781198 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd6d82-6aee-4fca-b52b-edf9e47aa5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.782428 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd6d82-6aee-4fca-b52b-edf9e47aa5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.782712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd6d82-6aee-4fca-b52b-edf9e47aa5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.782985 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd6d82-6aee-4fca-b52b-edf9e47aa5a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.783680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd6d82-6aee-4fca-b52b-edf9e47aa5a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.785629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd6d82-6aee-4fca-b52b-edf9e47aa5a8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.805448 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1352/2733] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:47 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:47.809520 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ce2d-ae79-408a-bdce-f04d859183cb admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:47.819805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ce2d-ae79-408a-bdce-f04d859183cb admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.824485 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8366d1-a524-45d3-841a-e6547bf9f807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.825145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8366d1-a524-45d3-841a-e6547bf9f807 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.825429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8366d1-a524-45d3-841a-e6547bf9f807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.825707 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8366d1-a524-45d3-841a-e6547bf9f807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.826434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8366d1-a524-45d3-841a-e6547bf9f807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.828024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8366d1-a524-45d3-841a-e6547bf9f807 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.838489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1382/2734] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:47.842677 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd6d82-6aee-4fca-b52b-edf9e47aa5a8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:47.853477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd6d82-6aee-4fca-b52b-edf9e47aa5a8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.858086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ec251-680b-486a-a838-ca39794c16d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.858962 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec251-680b-486a-a838-ca39794c16d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.859248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec251-680b-486a-a838-ca39794c16d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.859586 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec251-680b-486a-a838-ca39794c16d4 admin admin] PATH_INFO: `/v3/projects/127fe04c862e4d72b8689d6a94b3b326/users/cd2d7bf73dcd486c8c4512205be7ed8b/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.875403 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ec251-680b-486a-a838-ca39794c16d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127fe04c862e4d72b8689d6a94b3b326, user_id=cd2d7bf73dcd486c8c4512205be7ed8b, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.878041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ec251-680b-486a-a838-ca39794c16d4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.890369 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1353/2735] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:47 2022] PUT /identity/v3/projects/127fe04c862e4d72b8689d6a94b3b326/users/cd2d7bf73dcd486c8c4512205be7ed8b/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:47.894571 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8366d1-a524-45d3-841a-e6547bf9f807 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:47.905381 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8366d1-a524-45d3-841a-e6547bf9f807 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:47.938390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:47.974746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae3e4f-b077-4fa1-85e2-95ef52707f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:47.975471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3e4f-b077-4fa1-85e2-95ef52707f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:47.975717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3e4f-b077-4fa1-85e2-95ef52707f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:47.975997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3e4f-b077-4fa1-85e2-95ef52707f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:47.976777 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae3e4f-b077-4fa1-85e2-95ef52707f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:47.978403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae3e4f-b077-4fa1-85e2-95ef52707f96 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:47.988240 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1383/2736] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:47.992625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ec251-680b-486a-a838-ca39794c16d4 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:48.002876 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ec251-680b-486a-a838-ca39794c16d4 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:48.007436 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e664b96-99ed-48b1-bac9-9d9332968215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:48.008304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e664b96-99ed-48b1-bac9-9d9332968215 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:48.008612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e664b96-99ed-48b1-bac9-9d9332968215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:48.008884 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e664b96-99ed-48b1-bac9-9d9332968215 admin admin] PATH_INFO: `/v3/projects/127fe04c862e4d72b8689d6a94b3b326/users/cd2d7bf73dcd486c8c4512205be7ed8b/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:48.010838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e664b96-99ed-48b1-bac9-9d9332968215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127fe04c862e4d72b8689d6a94b3b326, user_id=cd2d7bf73dcd486c8c4512205be7ed8b, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:48.013485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e664b96-99ed-48b1-bac9-9d9332968215 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:48.024194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1354/2737] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:47 2022] PUT /identity/v3/projects/127fe04c862e4d72b8689d6a94b3b326/users/cd2d7bf73dcd486c8c4512205be7ed8b/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:48.035594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3be9f4-e8d6-4ba3-ba8b-56008c453469 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:48.035918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3be9f4-e8d6-4ba3-ba8b-56008c453469 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:48.036254 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3be9f4-e8d6-4ba3-ba8b-56008c453469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:48.062439 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-bc3be9f4-e8d6-4ba3-ba8b-56008c453469 None None] MFA Rules not processed for user `cd2d7bf73dcd486c8c4512205be7ed8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:48.063662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-bc3be9f4-e8d6-4ba3-ba8b-56008c453469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:48.130924 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1384/2738] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:48.143337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e664b96-99ed-48b1-bac9-9d9332968215 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:48.145059 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4e664b96-99ed-48b1-bac9-9d9332968215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:48.202924 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e664b96-99ed-48b1-bac9-9d9332968215 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:48.207829 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24080d1c-b14d-4db5-a809-d338e3582821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:48.208618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24080d1c-b14d-4db5-a809-d338e3582821 service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:48.208939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24080d1c-b14d-4db5-a809-d338e3582821 service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:48.209507 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24080d1c-b14d-4db5-a809-d338e3582821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:48.220417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24080d1c-b14d-4db5-a809-d338e3582821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:48.221897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24080d1c-b14d-4db5-a809-d338e3582821 service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:48.232819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1355/2739] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:48.314471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3be9f4-e8d6-4ba3-ba8b-56008c453469 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:48.316275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-bc3be9f4-e8d6-4ba3-ba8b-56008c453469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:48.329232 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3be9f4-e8d6-4ba3-ba8b-56008c453469 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:48.332867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c9bb6-d832-42cc-a98f-68905c3c6f1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:48.333489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c9bb6-d832-42cc-a98f-68905c3c6f1a service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:48.333770 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c9bb6-d832-42cc-a98f-68905c3c6f1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:48.334044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c9bb6-d832-42cc-a98f-68905c3c6f1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:48.390267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c9bb6-d832-42cc-a98f-68905c3c6f1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:48.392243 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c9bb6-d832-42cc-a98f-68905c3c6f1a service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:48.401178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1385/2740] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:53.090219 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24080d1c-b14d-4db5-a809-d338e3582821 service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:53.130773 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:53.153548 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24080d1c-b14d-4db5-a809-d338e3582821 service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:53.158136 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:53.158998 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.159285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.159564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] PATH_INFO: `/v3/users/a02046f56a6a43e79171bd737b7d3113` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.160779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a02046f56a6a43e79171bd737b7d3113)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:53.162779 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:53.207791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a02046f56a6a43e79171bd737b7d3113'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.208423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a02046f56a6a43e79171bd737b7d3113'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.215229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a02046f56a6a43e79171bd737b7d3113'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.221838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a02046f56a6a43e79171bd737b7d3113'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.222468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a02046f56a6a43e79171bd737b7d3113'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.241110 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1356/2741] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:53 2022] DELETE /identity/v3/users/a02046f56a6a43e79171bd737b7d3113 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:53.245792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55a3c8-1f3b-4a93-801d-a9b632bff938 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.246247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55a3c8-1f3b-4a93-801d-a9b632bff938 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.246348 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55a3c8-1f3b-4a93-801d-a9b632bff938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.264396 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-ef55a3c8-1f3b-4a93-801d-a9b632bff938 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:53.265626 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ef55a3c8-1f3b-4a93-801d-a9b632bff938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:53.314685 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:53.327825 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1386/2742] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:53.337648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:53.339064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:53.397350 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9d1ae-fcbb-4c79-9b3f-6b09110416d3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:53.401305 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d29ef-72cf-47f2-b103-00b98296663d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:53.401953 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d29ef-72cf-47f2-b103-00b98296663d service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.402247 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d29ef-72cf-47f2-b103-00b98296663d service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.402508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d29ef-72cf-47f2-b103-00b98296663d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.412881 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d29ef-72cf-47f2-b103-00b98296663d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:53.414329 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d29ef-72cf-47f2-b103-00b98296663d service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:53.425174 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1357/2743] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:53.689716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55a3c8-1f3b-4a93-801d-a9b632bff938 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:53.691186 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ef55a3c8-1f3b-4a93-801d-a9b632bff938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:53.714310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55a3c8-1f3b-4a93-801d-a9b632bff938 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:53.721388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:53.722864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.723152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.723452 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] PATH_INFO: `/v3/projects/88638b4fd1af453ab2fcb1863ea070fd` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.724695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88638b4fd1af453ab2fcb1863ea070fd)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:53.726600 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:53.787568 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88638b4fd1af453ab2fcb1863ea070fd', 'request_id': 'req-2801403c-65e3-4795-9fa9-13a713c12fa7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.795164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88638b4fd1af453ab2fcb1863ea070fd', 'request_id': 'req-2801403c-65e3-4795-9fa9-13a713c12fa7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.802382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88638b4fd1af453ab2fcb1863ea070fd', 'request_id': 'req-2801403c-65e3-4795-9fa9-13a713c12fa7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.819021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] The token cache is being invalidate because project 88638b4fd1af453ab2fcb1863ea070fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:53.819321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.819988 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.821787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1387/2744] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:53 2022] DELETE /identity/v3/projects/88638b4fd1af453ab2fcb1863ea070fd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:53.825591 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d29ef-72cf-47f2-b103-00b98296663d service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:53.837734 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d29ef-72cf-47f2-b103-00b98296663d service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:53.895501 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbaef6-9de9-459b-b982-240725fe4bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:53.896405 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbaef6-9de9-459b-b982-240725fe4bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:53.896691 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbaef6-9de9-459b-b982-240725fe4bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:53.896969 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbaef6-9de9-459b-b982-240725fe4bf0 admin admin] PATH_INFO: `/v3/users/cd2d7bf73dcd486c8c4512205be7ed8b` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:53.898483 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbaef6-9de9-459b-b982-240725fe4bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2d7bf73dcd486c8c4512205be7ed8b)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:53.900074 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbaef6-9de9-459b-b982-240725fe4bf0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:53.901655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:53.949026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-48dbaef6-9de9-459b-b982-240725fe4bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2d7bf73dcd486c8c4512205be7ed8b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.949733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-48dbaef6-9de9-459b-b982-240725fe4bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2d7bf73dcd486c8c4512205be7ed8b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.957702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-48dbaef6-9de9-459b-b982-240725fe4bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2d7bf73dcd486c8c4512205be7ed8b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.966413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-48dbaef6-9de9-459b-b982-240725fe4bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2d7bf73dcd486c8c4512205be7ed8b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.967115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-48dbaef6-9de9-459b-b982-240725fe4bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2d7bf73dcd486c8c4512205be7ed8b'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:53.988194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1358/2745] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:53 2022] DELETE /identity/v3/users/cd2d7bf73dcd486c8c4512205be7ed8b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:54.642487 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.644193 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:54.660157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801403c-65e3-4795-9fa9-13a713c12fa7 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.720205 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.721031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.721320 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.721600 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] PATH_INFO: `/v3/projects/127fe04c862e4d72b8689d6a94b3b326` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.722881 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127fe04c862e4d72b8689d6a94b3b326)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.725021 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.772335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127fe04c862e4d72b8689d6a94b3b326', 'request_id': 'req-b9f9a807-d202-4894-8667-e32700d0ea23'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:54.777986 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127fe04c862e4d72b8689d6a94b3b326', 'request_id': 'req-b9f9a807-d202-4894-8667-e32700d0ea23'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:54.784247 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127fe04c862e4d72b8689d6a94b3b326', 'request_id': 'req-b9f9a807-d202-4894-8667-e32700d0ea23'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:54.798128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] The token cache is being invalidate because project 127fe04c862e4d72b8689d6a94b3b326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:54.798446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:54.799027 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b9f9a807-d202-4894-8667-e32700d0ea23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:54.800632 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1388/2746] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:54 2022] DELETE /identity/v3/projects/127fe04c862e4d72b8689d6a94b3b326 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:54.805576 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85d531-28f6-4e71-b6aa-cbca7a094026 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.806071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85d531-28f6-4e71-b6aa-cbca7a094026 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.806158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85d531-28f6-4e71-b6aa-cbca7a094026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.823422 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-5d85d531-28f6-4e71-b6aa-cbca7a094026 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:54.824821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-5d85d531-28f6-4e71-b6aa-cbca7a094026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:54.905908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1359/2747] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:54.915086 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498490d-4c9b-4fc9-bc28-f964e75adf8e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.915369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498490d-4c9b-4fc9-bc28-f964e75adf8e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.915648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498490d-4c9b-4fc9-bc28-f964e75adf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.934715 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:54.944465 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-c498490d-4c9b-4fc9-bc28-f964e75adf8e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:54.947002 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-c498490d-4c9b-4fc9-bc28-f964e75adf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:54.958130 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1389/2748] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:54.962363 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85d531-28f6-4e71-b6aa-cbca7a094026 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:54.974060 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85d531-28f6-4e71-b6aa-cbca7a094026 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:54.979254 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0badf2-692d-4b7a-9626-474eac436605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:54.979942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0badf2-692d-4b7a-9626-474eac436605 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:54.980384 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0badf2-692d-4b7a-9626-474eac436605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:54.980686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0badf2-692d-4b7a-9626-474eac436605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:54.981618 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0badf2-692d-4b7a-9626-474eac436605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:54.981941 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0badf2-692d-4b7a-9626-474eac436605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:54.983582 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0badf2-692d-4b7a-9626-474eac436605 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:54.997222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1360/2749] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:14:55.001078 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498490d-4c9b-4fc9-bc28-f964e75adf8e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:55.013121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498490d-4c9b-4fc9-bc28-f964e75adf8e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:55.019294 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd7c9a-deee-41fa-9c79-fd8015902651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:55.020554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd7c9a-deee-41fa-9c79-fd8015902651 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:55.020554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd7c9a-deee-41fa-9c79-fd8015902651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:55.020792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd7c9a-deee-41fa-9c79-fd8015902651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:55.021393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd7c9a-deee-41fa-9c79-fd8015902651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:55.023445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd7c9a-deee-41fa-9c79-fd8015902651 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:55.059894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1390/2750] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:54 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:55.064887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0badf2-692d-4b7a-9626-474eac436605 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:55.077980 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0badf2-692d-4b7a-9626-474eac436605 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:55.145856 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492689-c2d2-45e1-ac78-524cd28b2585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:55.146531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492689-c2d2-45e1-ac78-524cd28b2585 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:55.146848 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492689-c2d2-45e1-ac78-524cd28b2585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:55.147139 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2492689-c2d2-45e1-ac78-524cd28b2585 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:55.147832 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2492689-c2d2-45e1-ac78-524cd28b2585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:55.149790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2492689-c2d2-45e1-ac78-524cd28b2585 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:55.162936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:55.173624 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1361/2751] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:55 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:55.177607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd7c9a-deee-41fa-9c79-fd8015902651 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:55.189945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd7c9a-deee-41fa-9c79-fd8015902651 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:55.196087 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed5697-7363-44ca-b7aa-411dcc777502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:55.196798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed5697-7363-44ca-b7aa-411dcc777502 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:55.197087 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed5697-7363-44ca-b7aa-411dcc777502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:55.197369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed5697-7363-44ca-b7aa-411dcc777502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:55.198115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed5697-7363-44ca-b7aa-411dcc777502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:55.199750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed5697-7363-44ca-b7aa-411dcc777502 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:55.211591 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1391/2752] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:55.215754 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492689-c2d2-45e1-ac78-524cd28b2585 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:55.227512 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2492689-c2d2-45e1-ac78-524cd28b2585 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:55.238481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec1927-d698-4696-9002-5fe120a3161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:55.239165 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec1927-d698-4696-9002-5fe120a3161b admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:55.239453 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec1927-d698-4696-9002-5fe120a3161b admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:55.239733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec1927-d698-4696-9002-5fe120a3161b admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:55.240511 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec1927-d698-4696-9002-5fe120a3161b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:55.246966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec1927-d698-4696-9002-5fe120a3161b admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:55.262365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1362/2753] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:14:55.267466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed5697-7363-44ca-b7aa-411dcc777502 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:55.277334 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed5697-7363-44ca-b7aa-411dcc777502 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:55.281945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00771be5-e1e7-48b1-aa3e-481cbebc10f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:55.282875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771be5-e1e7-48b1-aa3e-481cbebc10f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:55.283159 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771be5-e1e7-48b1-aa3e-481cbebc10f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:55.283434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771be5-e1e7-48b1-aa3e-481cbebc10f0 admin admin] PATH_INFO: `/v3/projects/ba876a249d484fcfa8b20cf77ba44d78/users/d279530632f84a089da32a6070da10fc/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:55.298814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00771be5-e1e7-48b1-aa3e-481cbebc10f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba876a249d484fcfa8b20cf77ba44d78, user_id=d279530632f84a089da32a6070da10fc, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:55.301643 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00771be5-e1e7-48b1-aa3e-481cbebc10f0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:55.315398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1392/2754] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:55 2022] PUT /identity/v3/projects/ba876a249d484fcfa8b20cf77ba44d78/users/d279530632f84a089da32a6070da10fc/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:55.325905 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d7b39-6cc9-49b6-a400-86721cc47dc3 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:55.326196 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d7b39-6cc9-49b6-a400-86721cc47dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:55.326504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d7b39-6cc9-49b6-a400-86721cc47dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:55.353906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-de6d7b39-6cc9-49b6-a400-86721cc47dc3 None None] MFA Rules not processed for user `d279530632f84a089da32a6070da10fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:55.355144 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-de6d7b39-6cc9-49b6-a400-86721cc47dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:55.420799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1363/2755] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:55.431895 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00771be5-e1e7-48b1-aa3e-481cbebc10f0 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:55.433693 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-00771be5-e1e7-48b1-aa3e-481cbebc10f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:55.493655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00771be5-e1e7-48b1-aa3e-481cbebc10f0 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:55.497235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50063e1a-6eb4-4390-be8e-a5dde8761664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:55.497882 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50063e1a-6eb4-4390-be8e-a5dde8761664 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:55.498170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50063e1a-6eb4-4390-be8e-a5dde8761664 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:55.498453 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50063e1a-6eb4-4390-be8e-a5dde8761664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:55.507560 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50063e1a-6eb4-4390-be8e-a5dde8761664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:55.509034 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50063e1a-6eb4-4390-be8e-a5dde8761664 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:55.518419 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1393/2756] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:58.089526 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d7b39-6cc9-49b6-a400-86721cc47dc3 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.153394 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d7b39-6cc9-49b6-a400-86721cc47dc3 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.158411 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.159278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.159556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.159824 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] PATH_INFO: `/v3/users/d279530632f84a089da32a6070da10fc` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.161019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d279530632f84a089da32a6070da10fc)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.162930 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.210655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd279530632f84a089da32a6070da10fc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.211364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd279530632f84a089da32a6070da10fc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.226974 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd279530632f84a089da32a6070da10fc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.242190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd279530632f84a089da32a6070da10fc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.242847 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd279530632f84a089da32a6070da10fc'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.254948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:58.264141 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1364/2757] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:14:58 2022] DELETE /identity/v3/users/d279530632f84a089da32a6070da10fc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:58.269292 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b96c-d8f8-477c-ab2f-2af84fdb9ac1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.269839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b96c-d8f8-477c-ab2f-2af84fdb9ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.269839 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b96c-d8f8-477c-ab2f-2af84fdb9ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.286838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-fb19b96c-d8f8-477c-ab2f-2af84fdb9ac1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:58.288044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-fb19b96c-d8f8-477c-ab2f-2af84fdb9ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:58.347616 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1394/2758] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:14:58.357966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.359417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:58.425602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ccb8a-2503-4fe1-a96a-a7795ad96db7 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.429317 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f42240-6c61-4c14-acb9-60f7936a6453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.429966 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f42240-6c61-4c14-acb9-60f7936a6453 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.430249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f42240-6c61-4c14-acb9-60f7936a6453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.430527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f42240-6c61-4c14-acb9-60f7936a6453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.440435 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f42240-6c61-4c14-acb9-60f7936a6453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.441902 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f42240-6c61-4c14-acb9-60f7936a6453 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.451896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1365/2759] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:14:58.744588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19b96c-d8f8-477c-ab2f-2af84fdb9ac1 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.746043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-fb19b96c-d8f8-477c-ab2f-2af84fdb9ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:58.759036 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19b96c-d8f8-477c-ab2f-2af84fdb9ac1 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:58.763961 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:58.764535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.764919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.765270 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] PATH_INFO: `/v3/projects/ba876a249d484fcfa8b20cf77ba44d78` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.767128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba876a249d484fcfa8b20cf77ba44d78)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:58.769456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:58.813479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:58.820792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba876a249d484fcfa8b20cf77ba44d78', 'request_id': 'req-059e9c2d-de5f-4c1d-b410-b7861c67700a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.827337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba876a249d484fcfa8b20cf77ba44d78', 'request_id': 'req-059e9c2d-de5f-4c1d-b410-b7861c67700a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.834191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba876a249d484fcfa8b20cf77ba44d78', 'request_id': 'req-059e9c2d-de5f-4c1d-b410-b7861c67700a'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.847155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] The token cache is being invalidate because project ba876a249d484fcfa8b20cf77ba44d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:14:58.847625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.848386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-059e9c2d-de5f-4c1d-b410-b7861c67700a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:14:58.850213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1395/2760] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:14:58 2022] DELETE /identity/v3/projects/ba876a249d484fcfa8b20cf77ba44d78 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:58.854873 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0507ed8-8011-4929-940d-9e36877f03c4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.855158 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0507ed8-8011-4929-940d-9e36877f03c4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.855433 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0507ed8-8011-4929-940d-9e36877f03c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.873370 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-c0507ed8-8011-4929-940d-9e36877f03c4 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:58.874573 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c0507ed8-8011-4929-940d-9e36877f03c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:58.944139 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1366/2761] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:58.951979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d458349-294f-4da4-b401-2fd7ab13e24e None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:58.952361 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d458349-294f-4da4-b401-2fd7ab13e24e None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:58.952791 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d458349-294f-4da4-b401-2fd7ab13e24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:58.975054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8d458349-294f-4da4-b401-2fd7ab13e24e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:58.976499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8d458349-294f-4da4-b401-2fd7ab13e24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:58.984672 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1396/2762] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:58.989022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0507ed8-8011-4929-940d-9e36877f03c4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:58.999197 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0507ed8-8011-4929-940d-9e36877f03c4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.004724 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fc905-8d40-4dc2-8bf5-a1139ff7e26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.005379 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fc905-8d40-4dc2-8bf5-a1139ff7e26e admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.005659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fc905-8d40-4dc2-8bf5-a1139ff7e26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.005932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fc905-8d40-4dc2-8bf5-a1139ff7e26e admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.006659 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fc905-8d40-4dc2-8bf5-a1139ff7e26e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:14:59.007045 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fc905-8d40-4dc2-8bf5-a1139ff7e26e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.008686 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fc905-8d40-4dc2-8bf5-a1139ff7e26e admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.021315 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1367/2763] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 06:14:59.025697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d458349-294f-4da4-b401-2fd7ab13e24e None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:59.035436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d458349-294f-4da4-b401-2fd7ab13e24e None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.040477 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707fe14-daf1-46e5-b41c-ee571d5c08e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.041170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707fe14-daf1-46e5-b41c-ee571d5c08e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.041457 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707fe14-daf1-46e5-b41c-ee571d5c08e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.041737 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707fe14-daf1-46e5-b41c-ee571d5c08e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.042473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707fe14-daf1-46e5-b41c-ee571d5c08e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.044414 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707fe14-daf1-46e5-b41c-ee571d5c08e7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.074043 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1397/2764] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:14:59 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:14:59.077584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fc905-8d40-4dc2-8bf5-a1139ff7e26e admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:59.091111 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fc905-8d40-4dc2-8bf5-a1139ff7e26e admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.151009 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27903ac-fbc6-40ae-913a-ad4b87e418a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.151680 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27903ac-fbc6-40ae-913a-ad4b87e418a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.151965 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27903ac-fbc6-40ae-913a-ad4b87e418a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.152247 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27903ac-fbc6-40ae-913a-ad4b87e418a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.152968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27903ac-fbc6-40ae-913a-ad4b87e418a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.154923 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27903ac-fbc6-40ae-913a-ad4b87e418a2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.177927 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1368/2765] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:14:59 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:14:59.179586 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707fe14-daf1-46e5-b41c-ee571d5c08e7 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:59.190618 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707fe14-daf1-46e5-b41c-ee571d5c08e7 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.195288 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02d1d9-9df0-4973-8e3a-b79eb03992dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.195950 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d1d9-9df0-4973-8e3a-b79eb03992dd admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.196235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d1d9-9df0-4973-8e3a-b79eb03992dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.196554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02d1d9-9df0-4973-8e3a-b79eb03992dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.197284 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02d1d9-9df0-4973-8e3a-b79eb03992dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.198873 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02d1d9-9df0-4973-8e3a-b79eb03992dd admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.210047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1398/2766] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:59.213890 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27903ac-fbc6-40ae-913a-ad4b87e418a2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:59.224086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27903ac-fbc6-40ae-913a-ad4b87e418a2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.229957 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852585d8-1dbb-48b6-af37-503b17ed2ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.230689 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852585d8-1dbb-48b6-af37-503b17ed2ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.230981 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852585d8-1dbb-48b6-af37-503b17ed2ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.231263 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852585d8-1dbb-48b6-af37-503b17ed2ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.231992 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852585d8-1dbb-48b6-af37-503b17ed2ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.233622 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852585d8-1dbb-48b6-af37-503b17ed2ccd admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.248577 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1369/2767] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:14:59.249277 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02d1d9-9df0-4973-8e3a-b79eb03992dd admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:59.260561 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02d1d9-9df0-4973-8e3a-b79eb03992dd admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.266589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a8fc4-3290-45dc-869e-0259c16db01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.267554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a8fc4-3290-45dc-869e-0259c16db01a admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.267911 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a8fc4-3290-45dc-869e-0259c16db01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.268263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a8fc4-3290-45dc-869e-0259c16db01a admin admin] PATH_INFO: `/v3/projects/37f5b06eea4742e7b06001bf18e74d19/users/19ef68fcac2747dc97f3817ceb7d95c3/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.285044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a8fc4-3290-45dc-869e-0259c16db01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f5b06eea4742e7b06001bf18e74d19, user_id=19ef68fcac2747dc97f3817ceb7d95c3, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.288919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a8fc4-3290-45dc-869e-0259c16db01a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.307743 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1399/2768] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:14:59 2022] PUT /identity/v3/projects/37f5b06eea4742e7b06001bf18e74d19/users/19ef68fcac2747dc97f3817ceb7d95c3/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:14:59.318481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd542f-1d4e-470e-a13b-88fc88230453 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.318780 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd542f-1d4e-470e-a13b-88fc88230453 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.319064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd542f-1d4e-470e-a13b-88fc88230453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.325097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:59.349029 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-00fd542f-1d4e-470e-a13b-88fc88230453 None None] MFA Rules not processed for user `19ef68fcac2747dc97f3817ceb7d95c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:14:59.350364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-00fd542f-1d4e-470e-a13b-88fc88230453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:59.425026 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1370/2769] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:14:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:14:59.435141 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a8fc4-3290-45dc-869e-0259c16db01a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:14:59.437582 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-645a8fc4-3290-45dc-869e-0259c16db01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:14:59.499697 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a8fc4-3290-45dc-869e-0259c16db01a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:14:59.504228 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33914096-4c23-4166-904c-2512f4eb3a16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80f36041751a446885608f5a3b1f37df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:14:59.505366 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33914096-4c23-4166-904c-2512f4eb3a16 service glance] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:14:59.505650 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33914096-4c23-4166-904c-2512f4eb3a16 service glance] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:14:59.505937 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33914096-4c23-4166-904c-2512f4eb3a16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:14:59.516559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33914096-4c23-4166-904c-2512f4eb3a16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:14:59.518215 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33914096-4c23-4166-904c-2512f4eb3a16 service glance] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:14:59.527898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1400/2770] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:14:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:03.645564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd542f-1d4e-470e-a13b-88fc88230453 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:03.647376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-00fd542f-1d4e-470e-a13b-88fc88230453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:03.727022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd542f-1d4e-470e-a13b-88fc88230453 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:03.731376 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a69d0-075f-498d-b7ba-d15357c40cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:03.732055 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a69d0-075f-498d-b7ba-d15357c40cea service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:03.732359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a69d0-075f-498d-b7ba-d15357c40cea service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:03.732671 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a69d0-075f-498d-b7ba-d15357c40cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:03.735120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-388a69d0-075f-498d-b7ba-d15357c40cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:03.809926 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a69d0-075f-498d-b7ba-d15357c40cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:03.811400 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a69d0-075f-498d-b7ba-d15357c40cea service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:03.822678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1371/2771] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:04.591724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33914096-4c23-4166-904c-2512f4eb3a16 service glance] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:04.593534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-33914096-4c23-4166-904c-2512f4eb3a16 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:04.682746 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33914096-4c23-4166-904c-2512f4eb3a16 service glance] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:04.688790 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4432c-9243-4f76-bd8b-b1411e91ab6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e0b53aafc4bf3a23a7882ed12a89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:04.689536 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4432c-9243-4f76-bd8b-b1411e91ab6d service placement] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.689830 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4432c-9243-4f76-bd8b-b1411e91ab6d service placement] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.690116 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4432c-9243-4f76-bd8b-b1411e91ab6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.692032 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-19c4432c-9243-4f76-bd8b-b1411e91ab6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:04.704704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4432c-9243-4f76-bd8b-b1411e91ab6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:04.706248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4432c-9243-4f76-bd8b-b1411e91ab6d service placement] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:04.711045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:04.721194 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1401/2772] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:04.790908 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254afd-86df-49a5-9b80-3cceffe07ec0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:04.791483 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254afd-86df-49a5-9b80-3cceffe07ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:04.791584 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d254afd-86df-49a5-9b80-3cceffe07ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:04.818063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-4d254afd-86df-49a5-9b80-3cceffe07ec0 None None] MFA Rules not processed for user `a1e2b838931c4c1ab97c391b34937f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:04.819337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-4d254afd-86df-49a5-9b80-3cceffe07ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:04.860634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:04.878498 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1372/2773] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:15:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:08.158605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4432c-9243-4f76-bd8b-b1411e91ab6d service placement] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:08.161148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-19c4432c-9243-4f76-bd8b-b1411e91ab6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:08.182221 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4432c-9243-4f76-bd8b-b1411e91ab6d service placement] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:08.187148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:08.188028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:08.188343 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:08.188625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] PATH_INFO: `/v3/users/58b97e802e4c4e73933e34507e44aea7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:08.189949 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b97e802e4c4e73933e34507e44aea7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:08.191885 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:08.260031 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b97e802e4c4e73933e34507e44aea7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.273831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b97e802e4c4e73933e34507e44aea7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.275251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b97e802e4c4e73933e34507e44aea7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.275887 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b97e802e4c4e73933e34507e44aea7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.295019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b97e802e4c4e73933e34507e44aea7'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.310248 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1402/2774] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:08 2022] DELETE /identity/v3/users/58b97e802e4c4e73933e34507e44aea7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:08.506972 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d254afd-86df-49a5-9b80-3cceffe07ec0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:08.537010 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d254afd-86df-49a5-9b80-3cceffe07ec0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:08.611769 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:08.612678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:08.612963 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:08.613236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] PATH_INFO: `/v3/projects/d00acb6eb5f64310a8446e8f1f13a1e8` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:08.614423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00acb6eb5f64310a8446e8f1f13a1e8)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:08.616372 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:08.662504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00acb6eb5f64310a8446e8f1f13a1e8', 'request_id': 'req-28872149-ee89-4dfc-969e-2b9f19adecf2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.668079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00acb6eb5f64310a8446e8f1f13a1e8', 'request_id': 'req-28872149-ee89-4dfc-969e-2b9f19adecf2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.676704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00acb6eb5f64310a8446e8f1f13a1e8', 'request_id': 'req-28872149-ee89-4dfc-969e-2b9f19adecf2'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.688278 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] The token cache is being invalidate because project d00acb6eb5f64310a8446e8f1f13a1e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:08.688593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.689273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.690825 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1373/2775] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:08 2022] DELETE /identity/v3/projects/d00acb6eb5f64310a8446e8f1f13a1e8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:08.694890 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:08.696478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:08.710136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66e11-b67d-4392-93a3-12e52c4a27fb admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:08.771104 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72e48d-82e6-446d-a0c5-c89d9f830385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:08.771983 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72e48d-82e6-446d-a0c5-c89d9f830385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:08.772268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72e48d-82e6-446d-a0c5-c89d9f830385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:08.772579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72e48d-82e6-446d-a0c5-c89d9f830385 admin admin] PATH_INFO: `/v3/users/fcae1b10d99d46d4ba0fe62d091d6ef4` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:08.773805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72e48d-82e6-446d-a0c5-c89d9f830385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcae1b10d99d46d4ba0fe62d091d6ef4)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:08.775765 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72e48d-82e6-446d-a0c5-c89d9f830385 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:08.822769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ee72e48d-82e6-446d-a0c5-c89d9f830385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcae1b10d99d46d4ba0fe62d091d6ef4'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.829645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ee72e48d-82e6-446d-a0c5-c89d9f830385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcae1b10d99d46d4ba0fe62d091d6ef4'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.830389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ee72e48d-82e6-446d-a0c5-c89d9f830385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcae1b10d99d46d4ba0fe62d091d6ef4'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.831001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ee72e48d-82e6-446d-a0c5-c89d9f830385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcae1b10d99d46d4ba0fe62d091d6ef4'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.841829 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:08.843011 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-ee72e48d-82e6-446d-a0c5-c89d9f830385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcae1b10d99d46d4ba0fe62d091d6ef4'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:08.858157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1403/2776] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:08 2022] DELETE /identity/v3/users/fcae1b10d99d46d4ba0fe62d091d6ef4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:09.041340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:09.042855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:09.058383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28872149-ee89-4dfc-969e-2b9f19adecf2 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:09.119374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:09.120450 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:09.120738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:09.121014 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] PATH_INFO: `/v3/projects/927855ba1a9845569ad811b5137117e2` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:09.122262 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=927855ba1a9845569ad811b5137117e2)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:09.124208 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:09.147805 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:09.180103 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '927855ba1a9845569ad811b5137117e2', 'request_id': 'req-73e4dd28-c855-417f-bc2f-914851676a74'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:09.185977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '927855ba1a9845569ad811b5137117e2', 'request_id': 'req-73e4dd28-c855-417f-bc2f-914851676a74'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:09.193326 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '927855ba1a9845569ad811b5137117e2', 'request_id': 'req-73e4dd28-c855-417f-bc2f-914851676a74'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:09.205533 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] The token cache is being invalidate because project 927855ba1a9845569ad811b5137117e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:09.205739 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:09.206373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:09.207992 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1374/2777] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:09 2022] DELETE /identity/v3/projects/927855ba1a9845569ad811b5137117e2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:18.854376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=3,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:19.201730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:19.207444 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1146-2819-49af-8e6f-94c96e423857 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.207821 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1146-2819-49af-8e6f-94c96e423857 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.208173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1146-2819-49af-8e6f-94c96e423857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.225393 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-eb5e1146-2819-49af-8e6f-94c96e423857 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:19.226593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-eb5e1146-2819-49af-8e6f-94c96e423857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:19.284960 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1404/2778] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jun 20 06:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:19.305283 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:19.306700 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:19.378519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4dd28-c855-417f-bc2f-914851676a74 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:19.384236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240923-ae63-459d-8eed-e4f735c40bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:19.384942 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240923-ae63-459d-8eed-e4f735c40bab service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:19.385230 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240923-ae63-459d-8eed-e4f735c40bab service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:19.385508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240923-ae63-459d-8eed-e4f735c40bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:19.394649 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75240923-ae63-459d-8eed-e4f735c40bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:19.396229 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75240923-ae63-459d-8eed-e4f735c40bab service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:19.405595 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1375/2779] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:22.205443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1146-2819-49af-8e6f-94c96e423857 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:22.207443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-eb5e1146-2819-49af-8e6f-94c96e423857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:22.222265 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1146-2819-49af-8e6f-94c96e423857 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:22.227400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:22.228391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.228729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.229095 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] PATH_INFO: `/v3/users/19ef68fcac2747dc97f3817ceb7d95c3` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.234752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ef68fcac2747dc97f3817ceb7d95c3)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:22.234752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:22.301150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ef68fcac2747dc97f3817ceb7d95c3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:22.308925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ef68fcac2747dc97f3817ceb7d95c3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:22.309623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ef68fcac2747dc97f3817ceb7d95c3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:22.310359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ef68fcac2747dc97f3817ceb7d95c3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:22.326700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ef68fcac2747dc97f3817ceb7d95c3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:22.346473 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1405/2780] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:15:22 2022] DELETE /identity/v3/users/19ef68fcac2747dc97f3817ceb7d95c3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:15:22.350932 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4d2a1-5bdc-45ab-9f27-61046741c81e None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.351608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4d2a1-5bdc-45ab-9f27-61046741c81e None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.351608 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4d2a1-5bdc-45ab-9f27-61046741c81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.375564 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-83c4d2a1-5bdc-45ab-9f27-61046741c81e None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:22.376819 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-83c4d2a1-5bdc-45ab-9f27-61046741c81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:22.446357 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1376/2781] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:22.457606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:22.459359 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:22.493053 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd5611-393b-428d-b89a-09e58265a85b None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.493342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd5611-393b-428d-b89a-09e58265a85b None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.493629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd5611-393b-428d-b89a-09e58265a85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.512955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-d1bd5611-393b-428d-b89a-09e58265a85b None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:22.514171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d1bd5611-393b-428d-b89a-09e58265a85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:22.523045 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9128f-4708-4229-8ff0-3b1859fe3432 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:22.525724 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1377/2782] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jun 20 06:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:22.527134 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c02fb0-09a9-4077-97a7-7089a78197d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:22.528005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02fb0-09a9-4077-97a7-7089a78197d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.528471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02fb0-09a9-4077-97a7-7089a78197d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.528876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c02fb0-09a9-4077-97a7-7089a78197d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.539489 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c02fb0-09a9-4077-97a7-7089a78197d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:22.541056 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c02fb0-09a9-4077-97a7-7089a78197d7 service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:22.546660 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd5611-393b-428d-b89a-09e58265a85b None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:22.548005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d1bd5611-393b-428d-b89a-09e58265a85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:22.551009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1406/2783] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:22.647412 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd5611-393b-428d-b89a-09e58265a85b None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:22.653541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981cf4f-ca82-46b6-a073-c1df6f53961f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:22.654228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981cf4f-ca82-46b6-a073-c1df6f53961f service nova] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.654594 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981cf4f-ca82-46b6-a073-c1df6f53961f service nova] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.654897 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981cf4f-ca82-46b6-a073-c1df6f53961f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.666008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981cf4f-ca82-46b6-a073-c1df6f53961f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:22.668018 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981cf4f-ca82-46b6-a073-c1df6f53961f service nova] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:22.681107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1378/2784] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:15:22.850004 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c02fb0-09a9-4077-97a7-7089a78197d7 service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:22.851495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d7c02fb0-09a9-4077-97a7-7089a78197d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:22.865339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c02fb0-09a9-4077-97a7-7089a78197d7 service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:22.870023 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:22.870881 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:22.871164 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:22.871448 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] PATH_INFO: `/v3/projects/37f5b06eea4742e7b06001bf18e74d19` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:22.872805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f5b06eea4742e7b06001bf18e74d19)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:22.874747 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:22.886320 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:22.924871 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f5b06eea4742e7b06001bf18e74d19', 'request_id': 'req-179b96d3-f318-48c7-bc6d-c68e28d09883'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:22.930764 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f5b06eea4742e7b06001bf18e74d19', 'request_id': 'req-179b96d3-f318-48c7-bc6d-c68e28d09883'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:22.937750 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f5b06eea4742e7b06001bf18e74d19', 'request_id': 'req-179b96d3-f318-48c7-bc6d-c68e28d09883'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:22.950144 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] The token cache is being invalidate because project 37f5b06eea4742e7b06001bf18e74d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:15:22.950434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:22.951084 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:15:22.952717 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1407/2785] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:15:22 2022] DELETE /identity/v3/projects/37f5b06eea4742e7b06001bf18e74d19 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:15:25.566140 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b93c1e-4cdf-4cbb-ac37-711310654af5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:25.566637 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b93c1e-4cdf-4cbb-ac37-711310654af5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:25.566752 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b93c1e-4cdf-4cbb-ac37-711310654af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:25.574073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=100 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:25.585337 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-33b93c1e-4cdf-4cbb-ac37-711310654af5 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:25.586555 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-33b93c1e-4cdf-4cbb-ac37-711310654af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:25.643491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1379/2786] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jun 20 06:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:25.670326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:25.671778 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:25.743535 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b96d3-f318-48c7-bc6d-c68e28d09883 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:25.749001 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ef400-84cb-4fe9-9fbb-5a2cdb06c6bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:25.749683 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ef400-84cb-4fe9-9fbb-5a2cdb06c6bb service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:25.749971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ef400-84cb-4fe9-9fbb-5a2cdb06c6bb service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:25.750252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ef400-84cb-4fe9-9fbb-5a2cdb06c6bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:25.758726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ef400-84cb-4fe9-9fbb-5a2cdb06c6bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:25.760426 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ef400-84cb-4fe9-9fbb-5a2cdb06c6bb service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:25.771128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1408/2787] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:28.736583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bebe-374f-4627-bf75-166286f92d28 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:28.737123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bebe-374f-4627-bf75-166286f92d28 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:28.737123 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078bebe-374f-4627-bf75-166286f92d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:28.755804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0078bebe-374f-4627-bf75-166286f92d28 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:28.757209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0078bebe-374f-4627-bf75-166286f92d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:28.766518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1380/2788] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jun 20 06:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:28.803576 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ef400-84cb-4fe9-9fbb-5a2cdb06c6bb service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:28.805170 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-cf7ef400-84cb-4fe9-9fbb-5a2cdb06c6bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:28.821085 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ef400-84cb-4fe9-9fbb-5a2cdb06c6bb service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:28.826590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dccb8-c143-4404-9d7d-b18daa6d00b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:28.827267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dccb8-c143-4404-9d7d-b18daa6d00b5 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:28.827556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dccb8-c143-4404-9d7d-b18daa6d00b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:28.827834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dccb8-c143-4404-9d7d-b18daa6d00b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:28.835963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dccb8-c143-4404-9d7d-b18daa6d00b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:28.837589 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dccb8-c143-4404-9d7d-b18daa6d00b5 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:28.847456 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1409/2789] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:31.879530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c261e5b-ba90-443b-b76c-43ef5835c8f8 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:31.880019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c261e5b-ba90-443b-b76c-43ef5835c8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:31.880126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c261e5b-ba90-443b-b76c-43ef5835c8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:31.898244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-0c261e5b-ba90-443b-b76c-43ef5835c8f8 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:31.899529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0c261e5b-ba90-443b-b76c-43ef5835c8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:31.911780 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1381/2790] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Jun 20 06:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:15:31.937552 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dccb8-c143-4404-9d7d-b18daa6d00b5 service nova] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:31.948894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dccb8-c143-4404-9d7d-b18daa6d00b5 service nova] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:31.954312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1940480-65ad-40d2-a282-407adef678a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe8aea409c3459f9f7b3c3ef6ff583b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:31.954968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940480-65ad-40d2-a282-407adef678a1 service nova] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:31.955250 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940480-65ad-40d2-a282-407adef678a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:31.955522 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940480-65ad-40d2-a282-407adef678a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:31.963809 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1940480-65ad-40d2-a282-407adef678a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:31.965425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1940480-65ad-40d2-a282-407adef678a1 service nova] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:31.975486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1410/2791] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:41.893019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=31 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:41.971187 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:44.466933 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c261e5b-ba90-443b-b76c-43ef5835c8f8 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:15:44.468518 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-0c261e5b-ba90-443b-b76c-43ef5835c8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:44.546468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c261e5b-ba90-443b-b76c-43ef5835c8f8 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:15:44.552766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51be9ae-977a-4eb5-8267-3bb77b830405 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e0b53aafc4bf3a23a7882ed12a89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:15:44.553425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51be9ae-977a-4eb5-8267-3bb77b830405 service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:44.553714 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51be9ae-977a-4eb5-8267-3bb77b830405 service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:44.553993 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51be9ae-977a-4eb5-8267-3bb77b830405 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:44.555846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b51be9ae-977a-4eb5-8267-3bb77b830405 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:44.568012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51be9ae-977a-4eb5-8267-3bb77b830405 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:15:44.569657 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51be9ae-977a-4eb5-8267-3bb77b830405 service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:15:44.579633 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1382/2792] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:15:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:15:49.518300 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80908e-d5fe-4969-a878-cda4ee10a941 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:15:49.518887 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80908e-d5fe-4969-a878-cda4ee10a941 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:15:49.518887 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80908e-d5fe-4969-a878-cda4ee10a941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:15:49.537295 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-2d80908e-d5fe-4969-a878-cda4ee10a941 None None] MFA Rules not processed for user `e5604b0b261f477898ef2d5b9cc0dfea`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:15:49.538509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-2d80908e-d5fe-4969-a878-cda4ee10a941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:15:49.597383 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1411/2793] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:15:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:15:54.575252 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=32 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:59.590329 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=25 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:03.194470 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51be9ae-977a-4eb5-8267-3bb77b830405 service placement] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:03.195939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-b51be9ae-977a-4eb5-8267-3bb77b830405 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:03.210089 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51be9ae-977a-4eb5-8267-3bb77b830405 service placement] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:03.214566 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18286b33-e1f2-460c-8e0f-c4f4d9fe0c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:03.215455 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18286b33-e1f2-460c-8e0f-c4f4d9fe0c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:03.215732 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18286b33-e1f2-460c-8e0f-c4f4d9fe0c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:03.216003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18286b33-e1f2-460c-8e0f-c4f4d9fe0c00 admin admin] PATH_INFO: `/v3/users/a1e2b838931c4c1ab97c391b34937f2e` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:03.217285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18286b33-e1f2-460c-8e0f-c4f4d9fe0c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e2b838931c4c1ab97c391b34937f2e)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:03.219340 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18286b33-e1f2-460c-8e0f-c4f4d9fe0c00 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:03.266996 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-18286b33-e1f2-460c-8e0f-c4f4d9fe0c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e2b838931c4c1ab97c391b34937f2e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:03.267647 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-18286b33-e1f2-460c-8e0f-c4f4d9fe0c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e2b838931c4c1ab97c391b34937f2e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:03.275264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-18286b33-e1f2-460c-8e0f-c4f4d9fe0c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e2b838931c4c1ab97c391b34937f2e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:03.282113 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-18286b33-e1f2-460c-8e0f-c4f4d9fe0c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e2b838931c4c1ab97c391b34937f2e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:03.283096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-18286b33-e1f2-460c-8e0f-c4f4d9fe0c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e2b838931c4c1ab97c391b34937f2e'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:03.306040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1383/2794] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:16:03 2022] DELETE /identity/v3/users/a1e2b838931c4c1ab97c391b34937f2e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:16:03.480447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80908e-d5fe-4969-a878-cda4ee10a941 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:03.492188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80908e-d5fe-4969-a878-cda4ee10a941 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:03.549310 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:03.550662 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:03.550943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:03.551228 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] PATH_INFO: `/v3/projects/d9a990da1dfe4ba189fa9ef0856d5b57` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:03.552417 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a990da1dfe4ba189fa9ef0856d5b57)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:03.554314 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:03.598176 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a990da1dfe4ba189fa9ef0856d5b57', 'request_id': 'req-87619115-689d-4e10-bb79-0b86b02ae2b0'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:03.603531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a990da1dfe4ba189fa9ef0856d5b57', 'request_id': 'req-87619115-689d-4e10-bb79-0b86b02ae2b0'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:03.609661 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a990da1dfe4ba189fa9ef0856d5b57', 'request_id': 'req-87619115-689d-4e10-bb79-0b86b02ae2b0'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:03.622168 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] The token cache is being invalidate because project d9a990da1dfe4ba189fa9ef0856d5b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:16:03.622454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:03.623069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-87619115-689d-4e10-bb79-0b86b02ae2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:03.628481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1412/2795] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:16:03 2022] DELETE /identity/v3/projects/d9a990da1dfe4ba189fa9ef0856d5b57 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:16:03.630215 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc647b74-6ea5-41de-a100-0cb52cacfd48 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:03.630510 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc647b74-6ea5-41de-a100-0cb52cacfd48 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:03.630789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc647b74-6ea5-41de-a100-0cb52cacfd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:03.648862 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-dc647b74-6ea5-41de-a100-0cb52cacfd48 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:03.650075 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dc647b74-6ea5-41de-a100-0cb52cacfd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:03.707781 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1384/2796] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:03.715186 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7035da-b3fc-442d-98d2-1611019fb913 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:03.715508 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7035da-b3fc-442d-98d2-1611019fb913 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:03.715808 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7035da-b3fc-442d-98d2-1611019fb913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:03.736019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-af7035da-b3fc-442d-98d2-1611019fb913 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:03.737335 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-af7035da-b3fc-442d-98d2-1611019fb913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:03.745051 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1413/2797] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:03.749201 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc647b74-6ea5-41de-a100-0cb52cacfd48 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:03.761831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc647b74-6ea5-41de-a100-0cb52cacfd48 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:03.769171 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd12cf-7373-4b2f-b157-9541a385ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:03.770265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd12cf-7373-4b2f-b157-9541a385ad49 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:03.770599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd12cf-7373-4b2f-b157-9541a385ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:03.771004 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd12cf-7373-4b2f-b157-9541a385ad49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:03.771963 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd12cf-7373-4b2f-b157-9541a385ad49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:16:03.772414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd12cf-7373-4b2f-b157-9541a385ad49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:03.774137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd12cf-7373-4b2f-b157-9541a385ad49 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:03.786210 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1385/2798] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:16:03.790442 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7035da-b3fc-442d-98d2-1611019fb913 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:03.799914 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7035da-b3fc-442d-98d2-1611019fb913 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:03.804681 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3622e93-302f-48c7-a43b-f5d4de59dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:03.805357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622e93-302f-48c7-a43b-f5d4de59dea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:03.805645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622e93-302f-48c7-a43b-f5d4de59dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:03.805923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3622e93-302f-48c7-a43b-f5d4de59dea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:03.806619 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3622e93-302f-48c7-a43b-f5d4de59dea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:03.808541 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3622e93-302f-48c7-a43b-f5d4de59dea1 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:03.833578 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1414/2799] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:16:03 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:16:03.837845 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd12cf-7373-4b2f-b157-9541a385ad49 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:03.848538 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd12cf-7373-4b2f-b157-9541a385ad49 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:03.903342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b5e6b-5756-41bd-8b5d-cace145ad260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:03.904003 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5e6b-5756-41bd-8b5d-cace145ad260 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:03.904291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5e6b-5756-41bd-8b5d-cace145ad260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:03.904602 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b5e6b-5756-41bd-8b5d-cace145ad260 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:03.905294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b5e6b-5756-41bd-8b5d-cace145ad260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:03.907213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b5e6b-5756-41bd-8b5d-cace145ad260 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:03.913733 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:03.928683 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1386/2800] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:16:03 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 06:16:03.932736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3622e93-302f-48c7-a43b-f5d4de59dea1 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:03.944283 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3622e93-302f-48c7-a43b-f5d4de59dea1 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:03.948992 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71e229-8a61-47a0-84d6-6c6952086817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:03.949644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71e229-8a61-47a0-84d6-6c6952086817 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:03.949929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71e229-8a61-47a0-84d6-6c6952086817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:03.950208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71e229-8a61-47a0-84d6-6c6952086817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:03.950935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71e229-8a61-47a0-84d6-6c6952086817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:03.952598 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71e229-8a61-47a0-84d6-6c6952086817 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:03.963969 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1415/2801] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:16:03.967724 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b5e6b-5756-41bd-8b5d-cace145ad260 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:03.978135 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b5e6b-5756-41bd-8b5d-cace145ad260 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:03.982770 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fdd11-f763-41f3-8028-c790ea49ea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:03.983414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fdd11-f763-41f3-8028-c790ea49ea0c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:03.983701 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fdd11-f763-41f3-8028-c790ea49ea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:03.983981 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fdd11-f763-41f3-8028-c790ea49ea0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:03.984735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fdd11-f763-41f3-8028-c790ea49ea0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:03.986360 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fdd11-f763-41f3-8028-c790ea49ea0c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:03.996823 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1387/2802] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:16:04.000548 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71e229-8a61-47a0-84d6-6c6952086817 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:04.013287 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71e229-8a61-47a0-84d6-6c6952086817 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:04.018390 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf7c03-18d5-40e4-ae47-4e9be53e8234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:04.019279 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7c03-18d5-40e4-ae47-4e9be53e8234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:04.019738 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7c03-18d5-40e4-ae47-4e9be53e8234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:04.020236 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7c03-18d5-40e4-ae47-4e9be53e8234 admin admin] PATH_INFO: `/v3/projects/35868fa1f7ab4e9085ad19f7f5183ac3/users/d9975a73cca843df95499f6827f7decf/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:04.036951 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf7c03-18d5-40e4-ae47-4e9be53e8234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35868fa1f7ab4e9085ad19f7f5183ac3, user_id=d9975a73cca843df95499f6827f7decf, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:04.039610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf7c03-18d5-40e4-ae47-4e9be53e8234 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:04.055862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1416/2803] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:16:03 2022] PUT /identity/v3/projects/35868fa1f7ab4e9085ad19f7f5183ac3/users/d9975a73cca843df95499f6827f7decf/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:16:04.066203 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5b1fd-9ddb-4a6d-a9af-af3ae85ae925 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:04.066730 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5b1fd-9ddb-4a6d-a9af-af3ae85ae925 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:04.067057 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5b1fd-9ddb-4a6d-a9af-af3ae85ae925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:04.097496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-dac5b1fd-9ddb-4a6d-a9af-af3ae85ae925 None None] MFA Rules not processed for user `d9975a73cca843df95499f6827f7decf`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:04.098716 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-dac5b1fd-9ddb-4a6d-a9af-af3ae85ae925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:04.162743 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1388/2804] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:16:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:04.173513 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf7c03-18d5-40e4-ae47-4e9be53e8234 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:04.176268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-91bf7c03-18d5-40e4-ae47-4e9be53e8234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:04.207851 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:04.235653 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf7c03-18d5-40e4-ae47-4e9be53e8234 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:04.239400 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a5da1-2431-48f8-8e5e-f1f3a26b3d19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:04.240037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5da1-2431-48f8-8e5e-f1f3a26b3d19 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:04.240357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5da1-2431-48f8-8e5e-f1f3a26b3d19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:04.240641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a5da1-2431-48f8-8e5e-f1f3a26b3d19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:04.249694 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a5da1-2431-48f8-8e5e-f1f3a26b3d19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:04.251145 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a5da1-2431-48f8-8e5e-f1f3a26b3d19 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:04.260581 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1417/2805] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:14.159279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:14.202009 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5b1fd-9ddb-4a6d-a9af-af3ae85ae925 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:14.256510 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=14 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:14.264535 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5b1fd-9ddb-4a6d-a9af-af3ae85ae925 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:14.269226 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:14.270084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:14.270892 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:14.271176 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] PATH_INFO: `/v3/users/d9975a73cca843df95499f6827f7decf` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:14.272487 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9975a73cca843df95499f6827f7decf)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:14.274485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:14.318389 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9975a73cca843df95499f6827f7decf'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:14.319032 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9975a73cca843df95499f6827f7decf'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:14.325804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9975a73cca843df95499f6827f7decf'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:14.332831 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9975a73cca843df95499f6827f7decf'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:14.333964 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9975a73cca843df95499f6827f7decf'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:14.351393 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1389/2806] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:16:14 2022] DELETE /identity/v3/users/d9975a73cca843df95499f6827f7decf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:16:14.355979 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3f81-5a8e-4295-bbec-ccca87eef991 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:14.356267 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3f81-5a8e-4295-bbec-ccca87eef991 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:14.356569 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e3f81-5a8e-4295-bbec-ccca87eef991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:14.373123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-167e3f81-5a8e-4295-bbec-ccca87eef991 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:16:14.374322 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-167e3f81-5a8e-4295-bbec-ccca87eef991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:14.431352 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1418/2807] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:16:14.440780 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:14.442166 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:14.498368 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d828aa-5d01-4222-a320-c0615fa1c750 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:14.502020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c9c4-0b38-4d2e-bcf0-bfa4aeb1ebea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:14.502670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c9c4-0b38-4d2e-bcf0-bfa4aeb1ebea service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:14.502952 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c9c4-0b38-4d2e-bcf0-bfa4aeb1ebea service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:14.503227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c9c4-0b38-4d2e-bcf0-bfa4aeb1ebea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:14.512894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6c9c4-0b38-4d2e-bcf0-bfa4aeb1ebea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:14.514318 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6c9c4-0b38-4d2e-bcf0-bfa4aeb1ebea service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:14.524587 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1390/2808] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:16:14.791789 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3f81-5a8e-4295-bbec-ccca87eef991 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:16:14.793647 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-167e3f81-5a8e-4295-bbec-ccca87eef991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:16:14.806900 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e3f81-5a8e-4295-bbec-ccca87eef991 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:16:14.811488 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:16:14.812374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:16:14.812664 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:16:14.812968 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] PATH_INFO: `/v3/projects/35868fa1f7ab4e9085ad19f7f5183ac3` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:16:14.814169 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] RBAC: Authorizing `identity:delete_project(project_id=35868fa1f7ab4e9085ad19f7f5183ac3)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:16:14.816091 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:16:14.862679 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35868fa1f7ab4e9085ad19f7f5183ac3', 'request_id': 'req-57b01b90-6254-423e-ab5f-191d1a64bcab'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:14.868544 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35868fa1f7ab4e9085ad19f7f5183ac3', 'request_id': 'req-57b01b90-6254-423e-ab5f-191d1a64bcab'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:14.874594 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35868fa1f7ab4e9085ad19f7f5183ac3', 'request_id': 'req-57b01b90-6254-423e-ab5f-191d1a64bcab'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:14.887172 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] The token cache is being invalidate because project 35868fa1f7ab4e9085ad19f7f5183ac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:16:14.887481 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:14.888100 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:16:14.889921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1419/2809] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:16:14 2022] DELETE /identity/v3/projects/35868fa1f7ab4e9085ad19f7f5183ac3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:16:24.519705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:24.884207 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:01.189767 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c9c4-0b38-4d2e-bcf0-bfa4aeb1ebea service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:01.192146 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-20a6c9c4-0b38-4d2e-bcf0-bfa4aeb1ebea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:01.209367 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c9c4-0b38-4d2e-bcf0-bfa4aeb1ebea service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:01.277836 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099c38f-fb4e-4f5c-b8f6-93e20be31ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:01.278710 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099c38f-fb4e-4f5c-b8f6-93e20be31ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:01.278995 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099c38f-fb4e-4f5c-b8f6-93e20be31ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:01.279272 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099c38f-fb4e-4f5c-b8f6-93e20be31ae4 admin admin] PATH_INFO: `/v3/users/e5604b0b261f477898ef2d5b9cc0dfea` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:01.280551 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099c38f-fb4e-4f5c-b8f6-93e20be31ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5604b0b261f477898ef2d5b9cc0dfea)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:01.282472 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099c38f-fb4e-4f5c-b8f6-93e20be31ae4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:01.326529 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2099c38f-fb4e-4f5c-b8f6-93e20be31ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5604b0b261f477898ef2d5b9cc0dfea'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:01.327183 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2099c38f-fb4e-4f5c-b8f6-93e20be31ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5604b0b261f477898ef2d5b9cc0dfea'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:01.334489 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2099c38f-fb4e-4f5c-b8f6-93e20be31ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5604b0b261f477898ef2d5b9cc0dfea'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:01.341676 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2099c38f-fb4e-4f5c-b8f6-93e20be31ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5604b0b261f477898ef2d5b9cc0dfea'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:01.342303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-2099c38f-fb4e-4f5c-b8f6-93e20be31ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5604b0b261f477898ef2d5b9cc0dfea'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:01.359898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1391/2810] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:17:01 2022] DELETE /identity/v3/users/e5604b0b261f477898ef2d5b9cc0dfea => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:01.529610 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:01.531312 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:01.549676 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b01b90-6254-423e-ab5f-191d1a64bcab admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:01.605933 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:01.606792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:01.607077 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:01.607349 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] PATH_INFO: `/v3/projects/f024feca646b4e70b75034339a7920d8` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:01.608531 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f024feca646b4e70b75034339a7920d8)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:01.610492 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:01.656149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f024feca646b4e70b75034339a7920d8', 'request_id': 'req-5d106557-d9a5-4f1b-a810-6d8fbd749469'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:01.662997 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f024feca646b4e70b75034339a7920d8', 'request_id': 'req-5d106557-d9a5-4f1b-a810-6d8fbd749469'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:01.669058 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f024feca646b4e70b75034339a7920d8', 'request_id': 'req-5d106557-d9a5-4f1b-a810-6d8fbd749469'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:01.681583 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] The token cache is being invalidate because project f024feca646b4e70b75034339a7920d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:17:01.681867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:01.682499 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-5d106557-d9a5-4f1b-a810-6d8fbd749469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:01.684033 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1420/2811] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:17:01 2022] DELETE /identity/v3/projects/f024feca646b4e70b75034339a7920d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:01.689041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4449d44-1999-4b3d-84f6-5da0b278a636 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:01.689335 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4449d44-1999-4b3d-84f6-5da0b278a636 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:01.689617 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4449d44-1999-4b3d-84f6-5da0b278a636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:01.707151 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e4449d44-1999-4b3d-84f6-5da0b278a636 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:01.708400 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e4449d44-1999-4b3d-84f6-5da0b278a636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:01.766164 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1392/2812] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:01.773956 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638a60-b352-4407-b707-481908f52746 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:01.774242 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638a60-b352-4407-b707-481908f52746 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:01.774526 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638a60-b352-4407-b707-481908f52746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:01.792580 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-b4638a60-b352-4407-b707-481908f52746 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:01.793762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-b4638a60-b352-4407-b707-481908f52746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:01.802252 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1421/2813] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:01.806494 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4449d44-1999-4b3d-84f6-5da0b278a636 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:01.816181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4449d44-1999-4b3d-84f6-5da0b278a636 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:01.820804 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fee0b-7758-4157-977c-309b4bc061bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:01.821446 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fee0b-7758-4157-977c-309b4bc061bd admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:01.821723 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fee0b-7758-4157-977c-309b4bc061bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:01.821992 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fee0b-7758-4157-977c-309b4bc061bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:01.822702 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fee0b-7758-4157-977c-309b4bc061bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:17:01.823021 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fee0b-7758-4157-977c-309b4bc061bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:01.824612 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fee0b-7758-4157-977c-309b4bc061bd admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:01.835785 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1393/2814] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:17:01.839865 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638a60-b352-4407-b707-481908f52746 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:01.850054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638a60-b352-4407-b707-481908f52746 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:01.854674 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5120dd6-5a3e-47b6-b757-a237230a36bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:01.855336 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5120dd6-5a3e-47b6-b757-a237230a36bb admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:01.855615 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5120dd6-5a3e-47b6-b757-a237230a36bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:01.855888 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5120dd6-5a3e-47b6-b757-a237230a36bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:01.856614 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5120dd6-5a3e-47b6-b757-a237230a36bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:01.858556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5120dd6-5a3e-47b6-b757-a237230a36bb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:01.884273 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1422/2815] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:17:01 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:01.888291 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fee0b-7758-4157-977c-309b4bc061bd admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:01.898572 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fee0b-7758-4157-977c-309b4bc061bd admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:01.902076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:01.957343 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1e0d0-6b65-4455-add4-f157c6fa07b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:01.957928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e0d0-6b65-4455-add4-f157c6fa07b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:01.958209 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e0d0-6b65-4455-add4-f157c6fa07b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:01.958483 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e0d0-6b65-4455-add4-f157c6fa07b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:01.959187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1e0d0-6b65-4455-add4-f157c6fa07b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:01.961118 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba1e0d0-6b65-4455-add4-f157c6fa07b9 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:01.980763 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1394/2816] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:17:01 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:01.984805 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5120dd6-5a3e-47b6-b757-a237230a36bb admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:01.996225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5120dd6-5a3e-47b6-b757-a237230a36bb admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:02.000907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12be12a-cc79-4f62-9aeb-8b303dd25cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:02.001556 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12be12a-cc79-4f62-9aeb-8b303dd25cac admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.001838 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12be12a-cc79-4f62-9aeb-8b303dd25cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.002126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12be12a-cc79-4f62-9aeb-8b303dd25cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.002836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12be12a-cc79-4f62-9aeb-8b303dd25cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:02.004797 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12be12a-cc79-4f62-9aeb-8b303dd25cac admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:02.018233 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1423/2817] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:02.022531 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1e0d0-6b65-4455-add4-f157c6fa07b9 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:02.032245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1e0d0-6b65-4455-add4-f157c6fa07b9 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:02.037516 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51ea0f-ff9c-4cd0-b01a-5bf3e65b9b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:02.038172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ea0f-ff9c-4cd0-b01a-5bf3e65b9b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.038440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ea0f-ff9c-4cd0-b01a-5bf3e65b9b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.038712 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51ea0f-ff9c-4cd0-b01a-5bf3e65b9b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.039427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51ea0f-ff9c-4cd0-b01a-5bf3e65b9b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:02.041039 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51ea0f-ff9c-4cd0-b01a-5bf3e65b9b7c admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:02.050749 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1395/2818] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:02.054656 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12be12a-cc79-4f62-9aeb-8b303dd25cac admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:02.064539 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12be12a-cc79-4f62-9aeb-8b303dd25cac admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:02.069109 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda73e30-b085-4b25-83fc-73fb9db166fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:02.069977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda73e30-b085-4b25-83fc-73fb9db166fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.070258 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda73e30-b085-4b25-83fc-73fb9db166fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.070534 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda73e30-b085-4b25-83fc-73fb9db166fe admin admin] PATH_INFO: `/v3/projects/e1bb030dc7ff4ff19310376dc452da96/users/fca11cf1ee9949d898d777839b4b21f9/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.085320 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda73e30-b085-4b25-83fc-73fb9db166fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bb030dc7ff4ff19310376dc452da96, user_id=fca11cf1ee9949d898d777839b4b21f9, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:02.088022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda73e30-b085-4b25-83fc-73fb9db166fe admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:02.102767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1424/2819] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:17:02 2022] PUT /identity/v3/projects/e1bb030dc7ff4ff19310376dc452da96/users/fca11cf1ee9949d898d777839b4b21f9/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:02.112655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe221f5-495c-487e-9b80-278480323681 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.112962 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe221f5-495c-487e-9b80-278480323681 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.113243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe221f5-495c-487e-9b80-278480323681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.138673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-ffe221f5-495c-487e-9b80-278480323681 None None] MFA Rules not processed for user `fca11cf1ee9949d898d777839b4b21f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:02.140120 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ffe221f5-495c-487e-9b80-278480323681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:02.201491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1396/2820] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:02.205916 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda73e30-b085-4b25-83fc-73fb9db166fe admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:02.236394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:02.273152 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda73e30-b085-4b25-83fc-73fb9db166fe admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:02.278066 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076122c-00d8-4889-87a4-72dd5a7daa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:02.278756 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076122c-00d8-4889-87a4-72dd5a7daa47 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.279071 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076122c-00d8-4889-87a4-72dd5a7daa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.279374 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076122c-00d8-4889-87a4-72dd5a7daa47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.280090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076122c-00d8-4889-87a4-72dd5a7daa47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:02.282020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076122c-00d8-4889-87a4-72dd5a7daa47 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:02.307253 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1425/2821] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:17:02 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:02.311234 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe221f5-495c-487e-9b80-278480323681 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:02.321950 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe221f5-495c-487e-9b80-278480323681 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:02.376851 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d1434-5db9-418f-a286-74683c4b1ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:02.377513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d1434-5db9-418f-a286-74683c4b1ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.377799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d1434-5db9-418f-a286-74683c4b1ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.378078 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d1434-5db9-418f-a286-74683c4b1ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.379269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d1434-5db9-418f-a286-74683c4b1ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:02.381241 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d1434-5db9-418f-a286-74683c4b1ad4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:02.401264 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1397/2822] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:17:02 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:02.405225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076122c-00d8-4889-87a4-72dd5a7daa47 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:02.415607 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076122c-00d8-4889-87a4-72dd5a7daa47 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:02.420229 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e918aa-0257-4b01-8ff6-dce4665e7232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:02.420919 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e918aa-0257-4b01-8ff6-dce4665e7232 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.421203 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e918aa-0257-4b01-8ff6-dce4665e7232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.421482 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e918aa-0257-4b01-8ff6-dce4665e7232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.422208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e918aa-0257-4b01-8ff6-dce4665e7232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:02.423798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e918aa-0257-4b01-8ff6-dce4665e7232 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:02.434046 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1426/2823] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:02.437917 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d1434-5db9-418f-a286-74683c4b1ad4 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:02.444705 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:02.448639 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d1434-5db9-418f-a286-74683c4b1ad4 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:02.454287 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b34e0-c227-4f92-8931-4a42719f49bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:02.455181 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b34e0-c227-4f92-8931-4a42719f49bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.455463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b34e0-c227-4f92-8931-4a42719f49bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.455764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b34e0-c227-4f92-8931-4a42719f49bb admin admin] PATH_INFO: `/v3/projects/53f2688d5b444be58eea26c627c4385f/users/2c265dff676e4b7293bb875ecd8816d0/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.470672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b34e0-c227-4f92-8931-4a42719f49bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f2688d5b444be58eea26c627c4385f, user_id=2c265dff676e4b7293bb875ecd8816d0, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:02.473390 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b34e0-c227-4f92-8931-4a42719f49bb admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:02.486034 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1398/2824] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:17:02 2022] PUT /identity/v3/projects/53f2688d5b444be58eea26c627c4385f/users/2c265dff676e4b7293bb875ecd8816d0/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:02.489872 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e918aa-0257-4b01-8ff6-dce4665e7232 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:02.499729 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e918aa-0257-4b01-8ff6-dce4665e7232 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:02.555479 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b1c50-c191-4226-8c82-e32c1a1bfdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:02.556209 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1c50-c191-4226-8c82-e32c1a1bfdba admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.556435 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1c50-c191-4226-8c82-e32c1a1bfdba admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.556708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b1c50-c191-4226-8c82-e32c1a1bfdba admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.557428 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b1c50-c191-4226-8c82-e32c1a1bfdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:02.559006 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b1c50-c191-4226-8c82-e32c1a1bfdba admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:02.569065 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1427/2825] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:02.573331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b34e0-c227-4f92-8931-4a42719f49bb admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:02.584129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b34e0-c227-4f92-8931-4a42719f49bb admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:02.588789 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7465bc-baac-4eb7-8370-f6bf458dc109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:02.589665 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7465bc-baac-4eb7-8370-f6bf458dc109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.589948 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7465bc-baac-4eb7-8370-f6bf458dc109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.590228 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7465bc-baac-4eb7-8370-f6bf458dc109 admin admin] PATH_INFO: `/v3/projects/53f2688d5b444be58eea26c627c4385f/users/2c265dff676e4b7293bb875ecd8816d0/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.592216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7465bc-baac-4eb7-8370-f6bf458dc109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f2688d5b444be58eea26c627c4385f, user_id=2c265dff676e4b7293bb875ecd8816d0, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:02.594961 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7465bc-baac-4eb7-8370-f6bf458dc109 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:02.605353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1399/2826] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:17:02 2022] PUT /identity/v3/projects/53f2688d5b444be58eea26c627c4385f/users/2c265dff676e4b7293bb875ecd8816d0/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:17:02.616276 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a6d2-4295-4d6d-89e0-da6547e02f2f None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.616615 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a6d2-4295-4d6d-89e0-da6547e02f2f None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.616894 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0a6d2-4295-4d6d-89e0-da6547e02f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.644014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-d6e0a6d2-4295-4d6d-89e0-da6547e02f2f None None] MFA Rules not processed for user `2c265dff676e4b7293bb875ecd8816d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:02.645834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-d6e0a6d2-4295-4d6d-89e0-da6547e02f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:02.711742 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1428/2827] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:02 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:02.723096 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7465bc-baac-4eb7-8370-f6bf458dc109 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:02.724855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-da7465bc-baac-4eb7-8370-f6bf458dc109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:02.782431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7465bc-baac-4eb7-8370-f6bf458dc109 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:02.786114 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b8ff5-62ee-41b3-acf1-8ee1676a4d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:02.786748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8ff5-62ee-41b3-acf1-8ee1676a4d5a service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.787027 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8ff5-62ee-41b3-acf1-8ee1676a4d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.787304 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8ff5-62ee-41b3-acf1-8ee1676a4d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.796190 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b8ff5-62ee-41b3-acf1-8ee1676a4d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:02.797653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b8ff5-62ee-41b3-acf1-8ee1676a4d5a service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:02.807482 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1400/2828] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:02 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:02.875887 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0a6d2-4295-4d6d-89e0-da6547e02f2f None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:02.885929 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0a6d2-4295-4d6d-89e0-da6547e02f2f None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:02.889827 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e578019-e394-4b2e-86e9-3df9f2cebed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:02.890454 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578019-e394-4b2e-86e9-3df9f2cebed6 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:02.890736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578019-e394-4b2e-86e9-3df9f2cebed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:02.891012 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578019-e394-4b2e-86e9-3df9f2cebed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:02.909754 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:02.947018 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578019-e394-4b2e-86e9-3df9f2cebed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:02.948568 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578019-e394-4b2e-86e9-3df9f2cebed6 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:02.957462 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1429/2829] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 06:17:05.647473 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b8ff5-62ee-41b3-acf1-8ee1676a4d5a service cinder] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:05.709402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b8ff5-62ee-41b3-acf1-8ee1676a4d5a service cinder] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:05.713986 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:05.714843 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:05.715124 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:05.715398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] PATH_INFO: `/v3/users/fca11cf1ee9949d898d777839b4b21f9` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:05.716609 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca11cf1ee9949d898d777839b4b21f9)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:05.718532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:05.763125 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca11cf1ee9949d898d777839b4b21f9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:05.763818 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca11cf1ee9949d898d777839b4b21f9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:05.771019 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca11cf1ee9949d898d777839b4b21f9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:05.778527 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca11cf1ee9949d898d777839b4b21f9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:05.779102 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca11cf1ee9949d898d777839b4b21f9'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:05.786020 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:05.799188 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1401/2830] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:17:05 2022] DELETE /identity/v3/users/fca11cf1ee9949d898d777839b4b21f9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:05.804251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4810-c018-48d6-92dd-1ae6561718d1 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:05.804768 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4810-c018-48d6-92dd-1ae6561718d1 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:05.804868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc4810-c018-48d6-92dd-1ae6561718d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:05.822342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-43bc4810-c018-48d6-92dd-1ae6561718d1 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:05.823545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-43bc4810-c018-48d6-92dd-1ae6561718d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:05.883708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1430/2831] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:05.894432 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:05.895936 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:05.952894 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4864a-5955-436c-87c5-2632368417f0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:05.956852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cab7b-844b-42c9-aff8-805d4b76c64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:05.957504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cab7b-844b-42c9-aff8-805d4b76c64f service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:05.957792 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cab7b-844b-42c9-aff8-805d4b76c64f service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:05.958072 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cab7b-844b-42c9-aff8-805d4b76c64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:05.967324 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cab7b-844b-42c9-aff8-805d4b76c64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:05.968797 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cab7b-844b-42c9-aff8-805d4b76c64f service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:05.978256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1402/2832] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:06.246322 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4810-c018-48d6-92dd-1ae6561718d1 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:06.248142 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-43bc4810-c018-48d6-92dd-1ae6561718d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:06.260874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc4810-c018-48d6-92dd-1ae6561718d1 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:06.266268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:06.267213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:06.267570 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:06.267925 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] PATH_INFO: `/v3/projects/e1bb030dc7ff4ff19310376dc452da96` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:06.269918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1bb030dc7ff4ff19310376dc452da96)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:06.272382 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:06.318736 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bb030dc7ff4ff19310376dc452da96', 'request_id': 'req-1ad43c35-9411-471f-9fc7-cb759f37d1b2'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.323948 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bb030dc7ff4ff19310376dc452da96', 'request_id': 'req-1ad43c35-9411-471f-9fc7-cb759f37d1b2'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.329967 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bb030dc7ff4ff19310376dc452da96', 'request_id': 'req-1ad43c35-9411-471f-9fc7-cb759f37d1b2'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.341787 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] The token cache is being invalidate because project e1bb030dc7ff4ff19310376dc452da96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:17:06.342075 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.342836 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.344424 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1431/2833] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:17:06 2022] DELETE /identity/v3/projects/e1bb030dc7ff4ff19310376dc452da96 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:06.349141 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cab7b-844b-42c9-aff8-805d4b76c64f service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:06.358906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cab7b-844b-42c9-aff8-805d4b76c64f service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:06.413934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d4b1d-b8c0-4310-81b4-a14c5329a8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:06.414798 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d4b1d-b8c0-4310-81b4-a14c5329a8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:06.415076 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d4b1d-b8c0-4310-81b4-a14c5329a8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:06.415348 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d4b1d-b8c0-4310-81b4-a14c5329a8fa admin admin] PATH_INFO: `/v3/users/2c265dff676e4b7293bb875ecd8816d0` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:06.416557 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d4b1d-b8c0-4310-81b4-a14c5329a8fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c265dff676e4b7293bb875ecd8816d0)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:06.418491 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d4b1d-b8c0-4310-81b4-a14c5329a8fa admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:06.462031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9d6d4b1d-b8c0-4310-81b4-a14c5329a8fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c265dff676e4b7293bb875ecd8816d0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.462673 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9d6d4b1d-b8c0-4310-81b4-a14c5329a8fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c265dff676e4b7293bb875ecd8816d0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.469709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9d6d4b1d-b8c0-4310-81b4-a14c5329a8fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c265dff676e4b7293bb875ecd8816d0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.477031 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9d6d4b1d-b8c0-4310-81b4-a14c5329a8fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c265dff676e4b7293bb875ecd8816d0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.477717 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9d6d4b1d-b8c0-4310-81b4-a14c5329a8fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c265dff676e4b7293bb875ecd8816d0'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.495314 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1403/2834] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:17:06 2022] DELETE /identity/v3/users/2c265dff676e4b7293bb875ecd8816d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:17:06.761104 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:06.762634 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:06.778126 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad43c35-9411-471f-9fc7-cb759f37d1b2 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:06.821728 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:06.838814 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:06.839759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:06.840049 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:06.840354 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] PATH_INFO: `/v3/projects/53f2688d5b444be58eea26c627c4385f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:06.841628 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f2688d5b444be58eea26c627c4385f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:06.843587 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:06.888579 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f2688d5b444be58eea26c627c4385f', 'request_id': 'req-b6c94c15-ae08-4e14-9940-6096455fad58'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.897406 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f2688d5b444be58eea26c627c4385f', 'request_id': 'req-b6c94c15-ae08-4e14-9940-6096455fad58'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.903443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f2688d5b444be58eea26c627c4385f', 'request_id': 'req-b6c94c15-ae08-4e14-9940-6096455fad58'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.915899 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] The token cache is being invalidate because project 53f2688d5b444be58eea26c627c4385f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:17:06.916213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.916857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-b6c94c15-ae08-4e14-9940-6096455fad58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:06.918380 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1432/2835] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:17:06 2022] DELETE /identity/v3/projects/53f2688d5b444be58eea26c627c4385f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:17:06.924216 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7d439-8929-458d-8a4b-4e394556c6d4 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:06.924731 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7d439-8929-458d-8a4b-4e394556c6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:06.924833 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7d439-8929-458d-8a4b-4e394556c6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:06.942481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a9f7d439-8929-458d-8a4b-4e394556c6d4 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:06.943681 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a9f7d439-8929-458d-8a4b-4e394556c6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:06.948929 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:07.003416 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1404/2836] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:07.011627 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371758b-b599-41c8-a0af-9a19668cfb20 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.011945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371758b-b599-41c8-a0af-9a19668cfb20 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.012224 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371758b-b599-41c8-a0af-9a19668cfb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.031268 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-9371758b-b599-41c8-a0af-9a19668cfb20 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:07.032509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-9371758b-b599-41c8-a0af-9a19668cfb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:07.040684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1433/2837] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:07.044790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7d439-8929-458d-8a4b-4e394556c6d4 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.054457 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7d439-8929-458d-8a4b-4e394556c6d4 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.059142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06167f29-535a-4d8e-bad1-92d9fa75cce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.059787 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06167f29-535a-4d8e-bad1-92d9fa75cce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.060073 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06167f29-535a-4d8e-bad1-92d9fa75cce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.060378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06167f29-535a-4d8e-bad1-92d9fa75cce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.061097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06167f29-535a-4d8e-bad1-92d9fa75cce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:17:07.061407 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06167f29-535a-4d8e-bad1-92d9fa75cce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.063007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06167f29-535a-4d8e-bad1-92d9fa75cce4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.074795 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1405/2838] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:17:07.079057 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371758b-b599-41c8-a0af-9a19668cfb20 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.089140 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371758b-b599-41c8-a0af-9a19668cfb20 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.094060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944db08-d6b5-447c-868b-7337b3d0fffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.094529 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944db08-d6b5-447c-868b-7337b3d0fffb admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.094892 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944db08-d6b5-447c-868b-7337b3d0fffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.095124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944db08-d6b5-447c-868b-7337b3d0fffb admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.095816 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944db08-d6b5-447c-868b-7337b3d0fffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.097755 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944db08-d6b5-447c-868b-7337b3d0fffb admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.121762 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1434/2839] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:17:07 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:07.126227 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06167f29-535a-4d8e-bad1-92d9fa75cce4 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.136904 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06167f29-535a-4d8e-bad1-92d9fa75cce4 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.191997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aedf9c-8626-41b2-b2e9-4258fc2509c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.192683 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aedf9c-8626-41b2-b2e9-4258fc2509c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.192973 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aedf9c-8626-41b2-b2e9-4258fc2509c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.193248 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aedf9c-8626-41b2-b2e9-4258fc2509c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.193939 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aedf9c-8626-41b2-b2e9-4258fc2509c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.195887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aedf9c-8626-41b2-b2e9-4258fc2509c0 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.217852 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1406/2840] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:17:07 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:07.221947 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944db08-d6b5-447c-868b-7337b3d0fffb admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.232191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944db08-d6b5-447c-868b-7337b3d0fffb admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.237486 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68916b7-d4c8-4a66-b30d-6fb5b7b0fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.238146 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68916b7-d4c8-4a66-b30d-6fb5b7b0fadc admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.238931 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68916b7-d4c8-4a66-b30d-6fb5b7b0fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.239213 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68916b7-d4c8-4a66-b30d-6fb5b7b0fadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.239963 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68916b7-d4c8-4a66-b30d-6fb5b7b0fadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.241592 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68916b7-d4c8-4a66-b30d-6fb5b7b0fadc admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.252275 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1435/2841] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:07.257269 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aedf9c-8626-41b2-b2e9-4258fc2509c0 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.267452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aedf9c-8626-41b2-b2e9-4258fc2509c0 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.272148 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69719b-d159-461b-b34d-53569d29c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.272830 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69719b-d159-461b-b34d-53569d29c6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.273116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69719b-d159-461b-b34d-53569d29c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.273396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69719b-d159-461b-b34d-53569d29c6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.274116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69719b-d159-461b-b34d-53569d29c6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.275704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69719b-d159-461b-b34d-53569d29c6e6 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.285599 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1407/2842] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:07.289551 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68916b7-d4c8-4a66-b30d-6fb5b7b0fadc admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.299478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68916b7-d4c8-4a66-b30d-6fb5b7b0fadc admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.306623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191586b-2045-44ba-8a96-10240b1de9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.307502 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191586b-2045-44ba-8a96-10240b1de9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.307785 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191586b-2045-44ba-8a96-10240b1de9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.308060 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191586b-2045-44ba-8a96-10240b1de9ac admin admin] PATH_INFO: `/v3/projects/7fbe2aa700af487f8c14a89b4e70f247/users/675f732b0e5d4533b8a56f26e91f0abd/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.323833 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191586b-2045-44ba-8a96-10240b1de9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbe2aa700af487f8c14a89b4e70f247, user_id=675f732b0e5d4533b8a56f26e91f0abd, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.326498 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191586b-2045-44ba-8a96-10240b1de9ac admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.338678 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1436/2843] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:17:07 2022] PUT /identity/v3/projects/7fbe2aa700af487f8c14a89b4e70f247/users/675f732b0e5d4533b8a56f26e91f0abd/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:07.348901 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c68a82-7a83-4046-bbb4-91a45933e370 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.349137 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c68a82-7a83-4046-bbb4-91a45933e370 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.349421 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c68a82-7a83-4046-bbb4-91a45933e370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.375616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e3c68a82-7a83-4046-bbb4-91a45933e370 None None] MFA Rules not processed for user `675f732b0e5d4533b8a56f26e91f0abd`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:07.376909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e3c68a82-7a83-4046-bbb4-91a45933e370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:07.439652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1408/2844] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:07.444673 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191586b-2045-44ba-8a96-10240b1de9ac admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.508554 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191586b-2045-44ba-8a96-10240b1de9ac admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.513208 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f1b35-1e2e-45a9-bae3-af9390fd5c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.513849 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f1b35-1e2e-45a9-bae3-af9390fd5c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.514385 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f1b35-1e2e-45a9-bae3-af9390fd5c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.514661 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f1b35-1e2e-45a9-bae3-af9390fd5c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.515337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f1b35-1e2e-45a9-bae3-af9390fd5c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.517759 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f1b35-1e2e-45a9-bae3-af9390fd5c1f admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.532251 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:07.548866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1437/2845] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:17:07 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:07.550600 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c68a82-7a83-4046-bbb4-91a45933e370 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.561790 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c68a82-7a83-4046-bbb4-91a45933e370 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.565354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:07.619404 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5fd9c-1bea-4722-b29c-9c82195e3495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.620077 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5fd9c-1bea-4722-b29c-9c82195e3495 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.620375 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5fd9c-1bea-4722-b29c-9c82195e3495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.620655 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5fd9c-1bea-4722-b29c-9c82195e3495 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.621336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5fd9c-1bea-4722-b29c-9c82195e3495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.623265 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5fd9c-1bea-4722-b29c-9c82195e3495 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.644441 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1409/2846] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:17:07 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:07.647918 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f1b35-1e2e-45a9-bae3-af9390fd5c1f admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.658115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f1b35-1e2e-45a9-bae3-af9390fd5c1f admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.662731 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f809d8-d3d4-4e4e-8f1b-1775491d18a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.663376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f809d8-d3d4-4e4e-8f1b-1775491d18a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.663659 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f809d8-d3d4-4e4e-8f1b-1775491d18a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.663935 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f809d8-d3d4-4e4e-8f1b-1775491d18a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.664779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f809d8-d3d4-4e4e-8f1b-1775491d18a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.666376 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f809d8-d3d4-4e4e-8f1b-1775491d18a2 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.678740 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1438/2847] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:07.682537 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5fd9c-1bea-4722-b29c-9c82195e3495 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.692879 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5fd9c-1bea-4722-b29c-9c82195e3495 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.697397 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934359a-65f2-4376-85f9-23e71ded9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.698258 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934359a-65f2-4376-85f9-23e71ded9408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.698532 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934359a-65f2-4376-85f9-23e71ded9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.698800 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934359a-65f2-4376-85f9-23e71ded9408 admin admin] PATH_INFO: `/v3/projects/a1cef3a457794691bf14ce8070039f05/users/9f86b58534ea44cd9d9ec474cda9ec76/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.713589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934359a-65f2-4376-85f9-23e71ded9408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cef3a457794691bf14ce8070039f05, user_id=9f86b58534ea44cd9d9ec474cda9ec76, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.716467 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934359a-65f2-4376-85f9-23e71ded9408 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.728838 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1410/2848] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:17:07 2022] PUT /identity/v3/projects/a1cef3a457794691bf14ce8070039f05/users/9f86b58534ea44cd9d9ec474cda9ec76/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:07.732761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f809d8-d3d4-4e4e-8f1b-1775491d18a2 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.743641 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f809d8-d3d4-4e4e-8f1b-1775491d18a2 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.799896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b008f18-bd36-4bbf-919e-f92d4571de2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.800649 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b008f18-bd36-4bbf-919e-f92d4571de2e admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.801553 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b008f18-bd36-4bbf-919e-f92d4571de2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.801831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b008f18-bd36-4bbf-919e-f92d4571de2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.802553 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b008f18-bd36-4bbf-919e-f92d4571de2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.804138 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b008f18-bd36-4bbf-919e-f92d4571de2e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.813429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1439/2849] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:07.817899 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934359a-65f2-4376-85f9-23e71ded9408 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.829774 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934359a-65f2-4376-85f9-23e71ded9408 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:07.834468 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8859e03-320e-4c21-9540-e3779d876986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:07.835331 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8859e03-320e-4c21-9540-e3779d876986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.835613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8859e03-320e-4c21-9540-e3779d876986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.835885 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8859e03-320e-4c21-9540-e3779d876986 admin admin] PATH_INFO: `/v3/projects/a1cef3a457794691bf14ce8070039f05/users/9f86b58534ea44cd9d9ec474cda9ec76/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.837859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8859e03-320e-4c21-9540-e3779d876986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cef3a457794691bf14ce8070039f05, user_id=9f86b58534ea44cd9d9ec474cda9ec76, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:07.840485 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8859e03-320e-4c21-9540-e3779d876986 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:07.851044 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1411/2850] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:17:07 2022] PUT /identity/v3/projects/a1cef3a457794691bf14ce8070039f05/users/9f86b58534ea44cd9d9ec474cda9ec76/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:07.862225 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025b118-48f2-44f4-8556-5146e8b5c521 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:07.862695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025b118-48f2-44f4-8556-5146e8b5c521 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:07.862792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025b118-48f2-44f4-8556-5146e8b5c521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:07.889326 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-8025b118-48f2-44f4-8556-5146e8b5c521 None None] MFA Rules not processed for user `9f86b58534ea44cd9d9ec474cda9ec76`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:07.890446 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-8025b118-48f2-44f4-8556-5146e8b5c521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:07.958165 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1440/2851] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:07.969193 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8859e03-320e-4c21-9540-e3779d876986 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:07.970928 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-d8859e03-320e-4c21-9540-e3779d876986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:08.030322 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8859e03-320e-4c21-9540-e3779d876986 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:08.034237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ad396-382c-4433-a5aa-6f6b5bb6f89b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:08.034963 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ad396-382c-4433-a5aa-6f6b5bb6f89b service cinder] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:08.035249 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ad396-382c-4433-a5aa-6f6b5bb6f89b service cinder] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:08.035525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ad396-382c-4433-a5aa-6f6b5bb6f89b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:08.044688 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ad396-382c-4433-a5aa-6f6b5bb6f89b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:08.046172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ad396-382c-4433-a5aa-6f6b5bb6f89b service cinder] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:08.056156 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1412/2852] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:08.085857 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025b118-48f2-44f4-8556-5146e8b5c521 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:08.147800 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025b118-48f2-44f4-8556-5146e8b5c521 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:08.152386 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:08.153255 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:08.153540 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:08.153818 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] PATH_INFO: `/v3/users/675f732b0e5d4533b8a56f26e91f0abd` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:08.155014 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=675f732b0e5d4533b8a56f26e91f0abd)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:08.156971 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:08.162166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=100 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:08.201166 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675f732b0e5d4533b8a56f26e91f0abd'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.208005 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675f732b0e5d4533b8a56f26e91f0abd'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.208704 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675f732b0e5d4533b8a56f26e91f0abd'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.209314 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675f732b0e5d4533b8a56f26e91f0abd'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.220867 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675f732b0e5d4533b8a56f26e91f0abd'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.234070 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1441/2853] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:17:08 2022] DELETE /identity/v3/users/675f732b0e5d4533b8a56f26e91f0abd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:08.239821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044d01b-b3f5-43a9-8019-ce209db7c648 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:08.240097 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044d01b-b3f5-43a9-8019-ce209db7c648 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:08.240463 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044d01b-b3f5-43a9-8019-ce209db7c648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:08.258796 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-f044d01b-b3f5-43a9-8019-ce209db7c648 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:08.259981 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f044d01b-b3f5-43a9-8019-ce209db7c648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:08.318768 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1413/2854] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:08.328437 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:08.329868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:08.386174 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b38502-d60b-45a0-96bd-6c19494e8d52 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:08.390086 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a2b29-d365-4595-a304-3b596e71e92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:08.390727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a2b29-d365-4595-a304-3b596e71e92b service neutron] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:08.391015 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a2b29-d365-4595-a304-3b596e71e92b service neutron] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:08.391296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a2b29-d365-4595-a304-3b596e71e92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:08.400337 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a2b29-d365-4595-a304-3b596e71e92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:08.401752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a2b29-d365-4595-a304-3b596e71e92b service neutron] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:08.411695 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1442/2855] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:08.680715 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044d01b-b3f5-43a9-8019-ce209db7c648 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:08.682279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f044d01b-b3f5-43a9-8019-ce209db7c648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:08.690641 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:08.698303 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044d01b-b3f5-43a9-8019-ce209db7c648 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:08.705413 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:08.706236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:08.706520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:08.706865 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] PATH_INFO: `/v3/projects/7fbe2aa700af487f8c14a89b4e70f247` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:08.708520 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbe2aa700af487f8c14a89b4e70f247)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:08.710431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:08.756178 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbe2aa700af487f8c14a89b4e70f247', 'request_id': 'req-c58b0a60-5c84-4f61-864f-4808f85dc0ca'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.761784 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbe2aa700af487f8c14a89b4e70f247', 'request_id': 'req-c58b0a60-5c84-4f61-864f-4808f85dc0ca'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.770030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbe2aa700af487f8c14a89b4e70f247', 'request_id': 'req-c58b0a60-5c84-4f61-864f-4808f85dc0ca'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.781107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] The token cache is being invalidate because project 7fbe2aa700af487f8c14a89b4e70f247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:17:08.781398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.782041 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.783593 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1414/2856] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:17:08 2022] DELETE /identity/v3/projects/7fbe2aa700af487f8c14a89b4e70f247 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:08.788128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a2b29-d365-4595-a304-3b596e71e92b service neutron] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:08.797689 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a2b29-d365-4595-a304-3b596e71e92b service neutron] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:08.853314 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3e450-9cc4-4dca-9caa-934242a64842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:08.854188 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3e450-9cc4-4dca-9caa-934242a64842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:08.854475 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3e450-9cc4-4dca-9caa-934242a64842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:08.854753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3e450-9cc4-4dca-9caa-934242a64842 admin admin] PATH_INFO: `/v3/users/9f86b58534ea44cd9d9ec474cda9ec76` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:08.855945 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3e450-9cc4-4dca-9caa-934242a64842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f86b58534ea44cd9d9ec474cda9ec76)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:08.857904 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3e450-9cc4-4dca-9caa-934242a64842 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:08.894296 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:08.911934 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-52f3e450-9cc4-4dca-9caa-934242a64842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f86b58534ea44cd9d9ec474cda9ec76'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.918761 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-52f3e450-9cc4-4dca-9caa-934242a64842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f86b58534ea44cd9d9ec474cda9ec76'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.919415 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-52f3e450-9cc4-4dca-9caa-934242a64842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f86b58534ea44cd9d9ec474cda9ec76'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.920020 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-52f3e450-9cc4-4dca-9caa-934242a64842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f86b58534ea44cd9d9ec474cda9ec76'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.931896 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-52f3e450-9cc4-4dca-9caa-934242a64842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f86b58534ea44cd9d9ec474cda9ec76'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:08.944132 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1443/2857] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:17:08 2022] DELETE /identity/v3/users/9f86b58534ea44cd9d9ec474cda9ec76 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:09.454459 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:09.456024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:09.473312 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b0a60-5c84-4f61-864f-4808f85dc0ca admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:09.539536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:09.540336 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:09.540623 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:09.540896 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] PATH_INFO: `/v3/projects/a1cef3a457794691bf14ce8070039f05` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:09.542087 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1cef3a457794691bf14ce8070039f05)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:09.543994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:09.592327 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1cef3a457794691bf14ce8070039f05', 'request_id': 'req-089f55ba-7d1a-4177-b121-bdd35f52acd4'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:09.598256 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1cef3a457794691bf14ce8070039f05', 'request_id': 'req-089f55ba-7d1a-4177-b121-bdd35f52acd4'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:09.605616 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1cef3a457794691bf14ce8070039f05', 'request_id': 'req-089f55ba-7d1a-4177-b121-bdd35f52acd4'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:09.618279 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] The token cache is being invalidate because project a1cef3a457794691bf14ce8070039f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80116) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:17:09.618571 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:09.619206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-089f55ba-7d1a-4177-b121-bdd35f52acd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:09.620840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1415/2858] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:17:09 2022] DELETE /identity/v3/projects/a1cef3a457794691bf14ce8070039f05 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:09.625856 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523add-86fe-4010-ad8b-4fd5014e6bca None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:09.626150 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523add-86fe-4010-ad8b-4fd5014e6bca None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:09.626432 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d523add-86fe-4010-ad8b-4fd5014e6bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:09.645266 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-7d523add-86fe-4010-ad8b-4fd5014e6bca None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:09.646460 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-7d523add-86fe-4010-ad8b-4fd5014e6bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:09.703767 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1444/2859] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:09.712072 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d322f-23da-4e18-bb5a-6de7dec25ed0 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:09.712513 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d322f-23da-4e18-bb5a-6de7dec25ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:09.712903 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d322f-23da-4e18-bb5a-6de7dec25ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:09.731741 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-e30d322f-23da-4e18-bb5a-6de7dec25ed0 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:09.732984 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-e30d322f-23da-4e18-bb5a-6de7dec25ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:09.741353 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1416/2860] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:09.745533 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d523add-86fe-4010-ad8b-4fd5014e6bca None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:09.755618 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d523add-86fe-4010-ad8b-4fd5014e6bca None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:09.760185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b61b16-58ba-4df0-9a86-9cf480858f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:09.760862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b61b16-58ba-4df0-9a86-9cf480858f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:09.761149 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b61b16-58ba-4df0-9a86-9cf480858f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:09.761429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b61b16-58ba-4df0-9a86-9cf480858f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:09.762157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b61b16-58ba-4df0-9a86-9cf480858f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80115) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:17:09.762471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b61b16-58ba-4df0-9a86-9cf480858f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:09.764338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b61b16-58ba-4df0-9a86-9cf480858f22 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:09.775724 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1445/2861] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:17:09.779898 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d322f-23da-4e18-bb5a-6de7dec25ed0 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:09.789024 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d322f-23da-4e18-bb5a-6de7dec25ed0 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:09.793640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6d5d0-ed9a-4d2b-94e3-812b067304e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:09.794222 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d5d0-ed9a-4d2b-94e3-812b067304e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:09.794504 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d5d0-ed9a-4d2b-94e3-812b067304e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:09.794778 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d5d0-ed9a-4d2b-94e3-812b067304e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:09.795451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6d5d0-ed9a-4d2b-94e3-812b067304e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:09.797365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6d5d0-ed9a-4d2b-94e3-812b067304e8 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:09.801440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:09.832764 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1417/2862] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:17:09 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:09.836874 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b61b16-58ba-4df0-9a86-9cf480858f22 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:09.847088 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b61b16-58ba-4df0-9a86-9cf480858f22 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:09.905726 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8332c-25eb-4292-8b44-f01637ea11b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:09.906434 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8332c-25eb-4292-8b44-f01637ea11b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:09.906720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8332c-25eb-4292-8b44-f01637ea11b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:09.907015 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8332c-25eb-4292-8b44-f01637ea11b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:09.908338 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8332c-25eb-4292-8b44-f01637ea11b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:09.911368 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8332c-25eb-4292-8b44-f01637ea11b2 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:09.935110 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1446/2863] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:17:09 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:09.940012 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6d5d0-ed9a-4d2b-94e3-812b067304e8 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:09.950559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6d5d0-ed9a-4d2b-94e3-812b067304e8 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:09.955187 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bed4fc-5ab9-42b0-bb14-643c40eaf231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:09.955846 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed4fc-5ab9-42b0-bb14-643c40eaf231 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:09.956127 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed4fc-5ab9-42b0-bb14-643c40eaf231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:09.956442 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bed4fc-5ab9-42b0-bb14-643c40eaf231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:09.957194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bed4fc-5ab9-42b0-bb14-643c40eaf231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:09.958788 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bed4fc-5ab9-42b0-bb14-643c40eaf231 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:09.968652 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1418/2864] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:09.972588 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8332c-25eb-4292-8b44-f01637ea11b2 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:09.983216 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8332c-25eb-4292-8b44-f01637ea11b2 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:09.988910 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef9f62-f2cd-414d-a9d8-b53d0f059854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:09.990542 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef9f62-f2cd-414d-a9d8-b53d0f059854 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:09.990824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef9f62-f2cd-414d-a9d8-b53d0f059854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:09.991099 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef9f62-f2cd-414d-a9d8-b53d0f059854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:09.991824 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef9f62-f2cd-414d-a9d8-b53d0f059854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:09.993459 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef9f62-f2cd-414d-a9d8-b53d0f059854 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:10.008369 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1447/2865] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:10.012955 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bed4fc-5ab9-42b0-bb14-643c40eaf231 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:10.024365 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bed4fc-5ab9-42b0-bb14-643c40eaf231 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:10.029038 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60795f2e-cd18-45df-baf9-d08c89669215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:10.030001 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60795f2e-cd18-45df-baf9-d08c89669215 admin admin] REQUEST_METHOD: `PUT` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:10.030282 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60795f2e-cd18-45df-baf9-d08c89669215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:10.030559 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60795f2e-cd18-45df-baf9-d08c89669215 admin admin] PATH_INFO: `/v3/projects/2226dd083db442e0b0ad53823ee7921f/users/35eeb0d4f5fd4c3488b54e1b4c14fd22/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:10.046001 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60795f2e-cd18-45df-baf9-d08c89669215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2226dd083db442e0b0ad53823ee7921f, user_id=35eeb0d4f5fd4c3488b54e1b4c14fd22, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:10.048634 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60795f2e-cd18-45df-baf9-d08c89669215 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:10.062613 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1419/2866] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:17:10 2022] PUT /identity/v3/projects/2226dd083db442e0b0ad53823ee7921f/users/35eeb0d4f5fd4c3488b54e1b4c14fd22/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:17:10.073972 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b0b3-ad27-451c-a8ec-e0f64621ab1c None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:10.074264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b0b3-ad27-451c-a8ec-e0f64621ab1c None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:10.074545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b0b3-ad27-451c-a8ec-e0f64621ab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:10.098875 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:10.102263 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-ab16b0b3-ad27-451c-a8ec-e0f64621ab1c None None] MFA Rules not processed for user `35eeb0d4f5fd4c3488b54e1b4c14fd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:10.104064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-ab16b0b3-ad27-451c-a8ec-e0f64621ab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:10.169039 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1448/2867] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:10.173541 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60795f2e-cd18-45df-baf9-d08c89669215 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:10.236048 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60795f2e-cd18-45df-baf9-d08c89669215 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:10.242107 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddf4cc-b64e-488c-a821-892ac823e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:10.242766 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddf4cc-b64e-488c-a821-892ac823e1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:10.243070 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddf4cc-b64e-488c-a821-892ac823e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:10.243324 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddf4cc-b64e-488c-a821-892ac823e1f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:10.244022 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddf4cc-b64e-488c-a821-892ac823e1f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:10.245956 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddf4cc-b64e-488c-a821-892ac823e1f5 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:10.271427 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1420/2868] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:17:10 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:10.275445 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b0b3-ad27-451c-a8ec-e0f64621ab1c None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:10.286593 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b0b3-ad27-451c-a8ec-e0f64621ab1c None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:10.341185 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e05526-8de7-465d-9252-36893bdd8ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:10.341780 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e05526-8de7-465d-9252-36893bdd8ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:10.342074 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e05526-8de7-465d-9252-36893bdd8ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:10.342357 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e05526-8de7-465d-9252-36893bdd8ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:10.343047 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e05526-8de7-465d-9252-36893bdd8ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:10.345009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e05526-8de7-465d-9252-36893bdd8ee2 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:10.365295 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1449/2869] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:17:10 2022] POST /identity/v3/users => generated 301 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:10.369361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddf4cc-b64e-488c-a821-892ac823e1f5 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:10.379718 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddf4cc-b64e-488c-a821-892ac823e1f5 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:10.384388 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f668e5-345b-4219-b527-fc48858d6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:10.385072 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f668e5-345b-4219-b527-fc48858d6d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:10.385359 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f668e5-345b-4219-b527-fc48858d6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:10.385664 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f668e5-345b-4219-b527-fc48858d6d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:10.386414 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f668e5-345b-4219-b527-fc48858d6d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:10.388002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f668e5-345b-4219-b527-fc48858d6d13 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:10.399260 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1421/2870] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 06:17:10.403177 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e05526-8de7-465d-9252-36893bdd8ee2 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:10.413868 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e05526-8de7-465d-9252-36893bdd8ee2 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:10.418462 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad1fdc-a700-418a-8f3b-194a027fe86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:10.419327 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad1fdc-a700-418a-8f3b-194a027fe86a admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:10.419608 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad1fdc-a700-418a-8f3b-194a027fe86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:10.419883 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad1fdc-a700-418a-8f3b-194a027fe86a admin admin] PATH_INFO: `/v3/projects/b30ce3905fb841c38725ffb931083e86/users/515f75f237a144ef81648044e2598dd8/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:10.434157 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad1fdc-a700-418a-8f3b-194a027fe86a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30ce3905fb841c38725ffb931083e86, user_id=515f75f237a144ef81648044e2598dd8, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:10.436834 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad1fdc-a700-418a-8f3b-194a027fe86a admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:10.449096 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1450/2871] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:17:10 2022] PUT /identity/v3/projects/b30ce3905fb841c38725ffb931083e86/users/515f75f237a144ef81648044e2598dd8/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:17:10.453002 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f668e5-345b-4219-b527-fc48858d6d13 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:10.463425 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f668e5-345b-4219-b527-fc48858d6d13 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:10.518977 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8432de-39d5-4b7c-9703-e9e8247e5f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:10.519648 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8432de-39d5-4b7c-9703-e9e8247e5f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:10.519934 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8432de-39d5-4b7c-9703-e9e8247e5f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:10.520736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8432de-39d5-4b7c-9703-e9e8247e5f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:10.521496 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8432de-39d5-4b7c-9703-e9e8247e5f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:10.523088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8432de-39d5-4b7c-9703-e9e8247e5f07 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:10.532775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1422/2872] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:10.537394 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad1fdc-a700-418a-8f3b-194a027fe86a admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:10.547471 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad1fdc-a700-418a-8f3b-194a027fe86a admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:10.552328 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855535-d3e8-4a9f-8aca-e40024706bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:10.553198 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855535-d3e8-4a9f-8aca-e40024706bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:10.553478 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855535-d3e8-4a9f-8aca-e40024706bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:10.553749 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855535-d3e8-4a9f-8aca-e40024706bb7 admin admin] PATH_INFO: `/v3/projects/b30ce3905fb841c38725ffb931083e86/users/515f75f237a144ef81648044e2598dd8/roles/6c8f329fa3da4385b8d232e2613aa1e7` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:10.555688 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855535-d3e8-4a9f-8aca-e40024706bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30ce3905fb841c38725ffb931083e86, user_id=515f75f237a144ef81648044e2598dd8, role_id=6c8f329fa3da4385b8d232e2613aa1e7)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:10.558342 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855535-d3e8-4a9f-8aca-e40024706bb7 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:10.569514 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1451/2873] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:17:10 2022] PUT /identity/v3/projects/b30ce3905fb841c38725ffb931083e86/users/515f75f237a144ef81648044e2598dd8/roles/6c8f329fa3da4385b8d232e2613aa1e7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:17:10.579519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24457ca7-b8fc-448d-a0b8-fc8e7a35742d None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:10.579812 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24457ca7-b8fc-448d-a0b8-fc8e7a35742d None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:10.580086 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24457ca7-b8fc-448d-a0b8-fc8e7a35742d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:10.607011 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-24457ca7-b8fc-448d-a0b8-fc8e7a35742d None None] MFA Rules not processed for user `515f75f237a144ef81648044e2598dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:10.608206 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-24457ca7-b8fc-448d-a0b8-fc8e7a35742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:10.617471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:10.675449 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1423/2874] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:10.686923 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855535-d3e8-4a9f-8aca-e40024706bb7 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:10.688660 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-1d855535-d3e8-4a9f-8aca-e40024706bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:10.747397 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855535-d3e8-4a9f-8aca-e40024706bb7 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:10.750990 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120449b-e5ed-4a6e-bad2-eef8190d3b21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:10.751625 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120449b-e5ed-4a6e-bad2-eef8190d3b21 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:10.751907 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120449b-e5ed-4a6e-bad2-eef8190d3b21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:10.752178 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120449b-e5ed-4a6e-bad2-eef8190d3b21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:10.761072 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120449b-e5ed-4a6e-bad2-eef8190d3b21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:10.762495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120449b-e5ed-4a6e-bad2-eef8190d3b21 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:10.766807 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:10.774073 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1452/2875] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:10.901492 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24457ca7-b8fc-448d-a0b8-fc8e7a35742d None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:10.963342 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24457ca7-b8fc-448d-a0b8-fc8e7a35742d None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:10.967840 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:10.968736 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:10.969018 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:10.969294 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] PATH_INFO: `/v3/users/35eeb0d4f5fd4c3488b54e1b4c14fd22` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:10.970481 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35eeb0d4f5fd4c3488b54e1b4c14fd22)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:10.972431 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:11.018071 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35eeb0d4f5fd4c3488b54e1b4c14fd22'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.018738 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35eeb0d4f5fd4c3488b54e1b4c14fd22'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.026430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35eeb0d4f5fd4c3488b54e1b4c14fd22'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.033172 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35eeb0d4f5fd4c3488b54e1b4c14fd22'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.034028 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35eeb0d4f5fd4c3488b54e1b4c14fd22'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.051997 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1424/2876] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:17:10 2022] DELETE /identity/v3/users/35eeb0d4f5fd4c3488b54e1b4c14fd22 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:11.056708 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a43a-d976-41e0-90cf-15fca26d9a78 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:11.057171 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a43a-d976-41e0-90cf-15fca26d9a78 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:11.057298 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a43a-d976-41e0-90cf-15fca26d9a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:11.074943 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-64e0a43a-d976-41e0-90cf-15fca26d9a78 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:11.076121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-64e0a43a-d976-41e0-90cf-15fca26d9a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:11.133290 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1453/2877] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:11.143194 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:11.144625 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:11.174656 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:11.203629 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b9429-99cf-42a8-a994-ff0b8c958438 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:11.207245 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee09756-a682-4659-9dcd-1a2d7565a932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:11.207911 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee09756-a682-4659-9dcd-1a2d7565a932 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:11.208364 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee09756-a682-4659-9dcd-1a2d7565a932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:11.208810 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee09756-a682-4659-9dcd-1a2d7565a932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:11.217943 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee09756-a682-4659-9dcd-1a2d7565a932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:11.219380 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee09756-a682-4659-9dcd-1a2d7565a932 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:11.229063 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1425/2878] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:11.498173 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0a43a-d976-41e0-90cf-15fca26d9a78 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:11.499623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-64e0a43a-d976-41e0-90cf-15fca26d9a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:11.512549 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0a43a-d976-41e0-90cf-15fca26d9a78 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:11.517495 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:11.518391 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:11.518644 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:11.518921 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] PATH_INFO: `/v3/projects/2226dd083db442e0b0ad53823ee7921f` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:11.520113 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2226dd083db442e0b0ad53823ee7921f)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:11.522648 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:11.569959 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2226dd083db442e0b0ad53823ee7921f', 'request_id': 'req-27259e3d-79fb-4d98-8234-d12ac6c42a9c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.575545 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2226dd083db442e0b0ad53823ee7921f', 'request_id': 'req-27259e3d-79fb-4d98-8234-d12ac6c42a9c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.584624 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2226dd083db442e0b0ad53823ee7921f', 'request_id': 'req-27259e3d-79fb-4d98-8234-d12ac6c42a9c'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.597315 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] The token cache is being invalidate because project 2226dd083db442e0b0ad53823ee7921f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:17:11.597601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.598217 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.599798 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1454/2879] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:17:11 2022] DELETE /identity/v3/projects/2226dd083db442e0b0ad53823ee7921f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:11.603938 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee09756-a682-4659-9dcd-1a2d7565a932 service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:11.613615 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee09756-a682-4659-9dcd-1a2d7565a932 service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:11.670669 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa542382-c248-4bfd-9436-9dd2ebe54c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:11.671452 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa542382-c248-4bfd-9436-9dd2ebe54c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:11.671735 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa542382-c248-4bfd-9436-9dd2ebe54c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:11.672008 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa542382-c248-4bfd-9436-9dd2ebe54c5d admin admin] PATH_INFO: `/v3/users/515f75f237a144ef81648044e2598dd8` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:11.673212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa542382-c248-4bfd-9436-9dd2ebe54c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=515f75f237a144ef81648044e2598dd8)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:11.675396 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa542382-c248-4bfd-9436-9dd2ebe54c5d admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:11.721802 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fa542382-c248-4bfd-9436-9dd2ebe54c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515f75f237a144ef81648044e2598dd8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.722430 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fa542382-c248-4bfd-9436-9dd2ebe54c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515f75f237a144ef81648044e2598dd8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.729755 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fa542382-c248-4bfd-9436-9dd2ebe54c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515f75f237a144ef81648044e2598dd8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.736517 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fa542382-c248-4bfd-9436-9dd2ebe54c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515f75f237a144ef81648044e2598dd8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.737126 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-fa542382-c248-4bfd-9436-9dd2ebe54c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515f75f237a144ef81648044e2598dd8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:11.754508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1426/2880] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:17:11 2022] DELETE /identity/v3/users/515f75f237a144ef81648044e2598dd8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:12.031504 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:12.032996 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:12.047389 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27259e3d-79fb-4d98-8234-d12ac6c42a9c admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:12.105090 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:12.105880 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:12.106160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:12.106429 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] PATH_INFO: `/v3/projects/b30ce3905fb841c38725ffb931083e86` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:12.107623 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30ce3905fb841c38725ffb931083e86)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:12.109563 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:12.133951 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:12.157010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30ce3905fb841c38725ffb931083e86', 'request_id': 'req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:12.162866 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30ce3905fb841c38725ffb931083e86', 'request_id': 'req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:12.168769 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30ce3905fb841c38725ffb931083e86', 'request_id': 'req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:12.181832 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] The token cache is being invalidate because project b30ce3905fb841c38725ffb931083e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:17:12.182128 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:12.182760 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-fd0cf0e0-05f8-4c89-801a-f7aad407e4f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:12.184388 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1455/2881] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:17:12 2022] DELETE /identity/v3/projects/b30ce3905fb841c38725ffb931083e86 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:12.189217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce1950-9521-46be-a54d-d77b77b360f5 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:12.189508 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce1950-9521-46be-a54d-d77b77b360f5 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:12.189791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce1950-9521-46be-a54d-d77b77b360f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:12.206994 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-a7ce1950-9521-46be-a54d-d77b77b360f5 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:12.208195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-a7ce1950-9521-46be-a54d-d77b77b360f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:12.260590 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:12.277347 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1427/2882] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:12.285238 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c4e18-0384-4254-8bb6-e3575e440154 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:12.285524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c4e18-0384-4254-8bb6-e3575e440154 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:12.286301 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c4e18-0384-4254-8bb6-e3575e440154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:12.304860 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-dc6c4e18-0384-4254-8bb6-e3575e440154 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:12.306123 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-dc6c4e18-0384-4254-8bb6-e3575e440154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:12.314067 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1456/2883] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:12.318169 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce1950-9521-46be-a54d-d77b77b360f5 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:12.327776 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce1950-9521-46be-a54d-d77b77b360f5 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:12.332402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6d829-6777-4c8f-9215-3016017d3132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:12.333051 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6d829-6777-4c8f-9215-3016017d3132 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:12.333334 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6d829-6777-4c8f-9215-3016017d3132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:12.333640 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6d829-6777-4c8f-9215-3016017d3132 admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:12.334361 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6d829-6777-4c8f-9215-3016017d3132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:17:12.334672 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6d829-6777-4c8f-9215-3016017d3132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:12.336280 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6d829-6777-4c8f-9215-3016017d3132 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:12.347814 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1428/2884] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:17:12.352578 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c4e18-0384-4254-8bb6-e3575e440154 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:12.361855 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c4e18-0384-4254-8bb6-e3575e440154 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:12.367148 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f53d7-b124-4cea-a485-4b8870cf6430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:12.367811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f53d7-b124-4cea-a485-4b8870cf6430 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:12.368103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f53d7-b124-4cea-a485-4b8870cf6430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:12.368412 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f53d7-b124-4cea-a485-4b8870cf6430 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:12.369118 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f53d7-b124-4cea-a485-4b8870cf6430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:12.371054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f53d7-b124-4cea-a485-4b8870cf6430 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:12.396024 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1457/2885] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:17:12 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:12.400155 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6d829-6777-4c8f-9215-3016017d3132 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:12.410177 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6d829-6777-4c8f-9215-3016017d3132 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:12.466236 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1631540-db73-4eff-b7b2-b0de3a8637c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:12.466827 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1631540-db73-4eff-b7b2-b0de3a8637c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:12.467117 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1631540-db73-4eff-b7b2-b0de3a8637c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:12.467398 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1631540-db73-4eff-b7b2-b0de3a8637c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:12.468402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1631540-db73-4eff-b7b2-b0de3a8637c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:12.470374 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1631540-db73-4eff-b7b2-b0de3a8637c3 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:12.490213 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1429/2886] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:17:12 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:12.494425 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f53d7-b124-4cea-a485-4b8870cf6430 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:12.504991 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f53d7-b124-4cea-a485-4b8870cf6430 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:12.509803 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c2bda-715e-4ca7-bd9b-ca02e1d7de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:12.510466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c2bda-715e-4ca7-bd9b-ca02e1d7de66 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:12.510757 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c2bda-715e-4ca7-bd9b-ca02e1d7de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:12.511041 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c2bda-715e-4ca7-bd9b-ca02e1d7de66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:12.511781 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c2bda-715e-4ca7-bd9b-ca02e1d7de66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:12.513447 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c2bda-715e-4ca7-bd9b-ca02e1d7de66 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:12.525436 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1458/2887] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:12.529273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1631540-db73-4eff-b7b2-b0de3a8637c3 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:12.539888 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1631540-db73-4eff-b7b2-b0de3a8637c3 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:12.544583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31586f44-9d58-4233-8934-cc75fe72a506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:12.545237 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31586f44-9d58-4233-8934-cc75fe72a506 admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:12.545519 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31586f44-9d58-4233-8934-cc75fe72a506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:12.545793 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31586f44-9d58-4233-8934-cc75fe72a506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:12.546515 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31586f44-9d58-4233-8934-cc75fe72a506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:12.548129 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31586f44-9d58-4233-8934-cc75fe72a506 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:12.558614 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1430/2888] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:12.562703 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c2bda-715e-4ca7-bd9b-ca02e1d7de66 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:12.572898 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c2bda-715e-4ca7-bd9b-ca02e1d7de66 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:12.577645 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d4ca-7db4-4400-b8c3-b37cde6af823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:12.578546 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d4ca-7db4-4400-b8c3-b37cde6af823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:12.578862 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d4ca-7db4-4400-b8c3-b37cde6af823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:12.579124 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d4ca-7db4-4400-b8c3-b37cde6af823 admin admin] PATH_INFO: `/v3/projects/590751e949da44ffa37a429d38122dd3/users/6d61653635fb4f27907c6aa6adb990f1/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:12.593977 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1d4ca-7db4-4400-b8c3-b37cde6af823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=590751e949da44ffa37a429d38122dd3, user_id=6d61653635fb4f27907c6aa6adb990f1, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:12.596655 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1d4ca-7db4-4400-b8c3-b37cde6af823 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:12.610190 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1459/2889] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:17:12 2022] PUT /identity/v3/projects/590751e949da44ffa37a429d38122dd3/users/6d61653635fb4f27907c6aa6adb990f1/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 06:17:12.621253 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb674e-a03b-4624-8bca-4f8f06290657 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:12.621757 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb674e-a03b-4624-8bca-4f8f06290657 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:12.621859 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb674e-a03b-4624-8bca-4f8f06290657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:12.647855 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-75cb674e-a03b-4624-8bca-4f8f06290657 None None] MFA Rules not processed for user `6d61653635fb4f27907c6aa6adb990f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:12.649095 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-75cb674e-a03b-4624-8bca-4f8f06290657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:12.709837 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1431/2890] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:12.720362 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d4ca-7db4-4400-b8c3-b37cde6af823 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:12.722775 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-69f1d4ca-7db4-4400-b8c3-b37cde6af823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:12.779155 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d4ca-7db4-4400-b8c3-b37cde6af823 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:12.782766 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9dd19-0934-4ace-9aa1-55ccc1f4c899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:12.783402 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9dd19-0934-4ace-9aa1-55ccc1f4c899 service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:12.783684 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9dd19-0934-4ace-9aa1-55ccc1f4c899 service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:12.783958 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9dd19-0934-4ace-9aa1-55ccc1f4c899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:12.792635 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9dd19-0934-4ace-9aa1-55ccc1f4c899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:12.794054 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9dd19-0934-4ace-9aa1-55ccc1f4c899 service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:12.802786 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1460/2891] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:15.751401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb674e-a03b-4624-8bca-4f8f06290657 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:15.798030 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:15.816383 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb674e-a03b-4624-8bca-4f8f06290657 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:15.820843 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:15.821704 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:15.821983 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:15.822255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] PATH_INFO: `/v3/users/6d61653635fb4f27907c6aa6adb990f1` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:15.823651 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d61653635fb4f27907c6aa6adb990f1)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:15.825834 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:15.870417 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d61653635fb4f27907c6aa6adb990f1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:15.871088 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d61653635fb4f27907c6aa6adb990f1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:15.877771 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d61653635fb4f27907c6aa6adb990f1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:15.884976 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d61653635fb4f27907c6aa6adb990f1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:15.885589 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d61653635fb4f27907c6aa6adb990f1'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:15.902530 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1432/2892] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:17:15 2022] DELETE /identity/v3/users/6d61653635fb4f27907c6aa6adb990f1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:15.906978 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633e57-68b2-4ef1-a3da-2207c51c39ec None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:15.907443 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633e57-68b2-4ef1-a3da-2207c51c39ec None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:15.907559 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633e57-68b2-4ef1-a3da-2207c51c39ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:15.924811 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-50633e57-68b2-4ef1-a3da-2207c51c39ec None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:15.926010 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-50633e57-68b2-4ef1-a3da-2207c51c39ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:15.969841 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:15.986264 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1461/2893] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:15.996402 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:15.997791 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:16.053775 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d630-8e21-4d83-b0f2-a7dae1d18e31 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:16.057378 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6d637-1ea5-45e0-9717-2d3dc3ea3859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:16.058007 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6d637-1ea5-45e0-9717-2d3dc3ea3859 service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:16.058285 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6d637-1ea5-45e0-9717-2d3dc3ea3859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:16.058556 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6d637-1ea5-45e0-9717-2d3dc3ea3859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:16.067373 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6d637-1ea5-45e0-9717-2d3dc3ea3859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:16.068901 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6d637-1ea5-45e0-9717-2d3dc3ea3859 service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:16.078079 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1433/2894] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:16.336235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50633e57-68b2-4ef1-a3da-2207c51c39ec None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:16.337691 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-50633e57-68b2-4ef1-a3da-2207c51c39ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:16.350469 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50633e57-68b2-4ef1-a3da-2207c51c39ec None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:16.355133 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:16.356022 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:16.356306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:16.356605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] PATH_INFO: `/v3/projects/590751e949da44ffa37a429d38122dd3` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:16.357792 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=590751e949da44ffa37a429d38122dd3)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:16.359700 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:16.404902 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590751e949da44ffa37a429d38122dd3', 'request_id': 'req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:16.410449 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590751e949da44ffa37a429d38122dd3', 'request_id': 'req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:16.417102 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590751e949da44ffa37a429d38122dd3', 'request_id': 'req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:16.429069 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] The token cache is being invalidate because project 590751e949da44ffa37a429d38122dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:17:16.429356 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:16.430009 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-bdf1766a-2560-4b4d-b449-0ac7f7415ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:16.431524 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1462/2895] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:17:16 2022] DELETE /identity/v3/projects/590751e949da44ffa37a429d38122dd3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:16.436440 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2723f-a354-497b-8f8f-5ba6bfc1d339 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:16.436729 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2723f-a354-497b-8f8f-5ba6bfc1d339 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:16.437005 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2723f-a354-497b-8f8f-5ba6bfc1d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:16.454212 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-72d2723f-a354-497b-8f8f-5ba6bfc1d339 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:16.455444 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-72d2723f-a354-497b-8f8f-5ba6bfc1d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:16.513115 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1434/2896] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 06:17:16.522028 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276af89-d1a7-4264-8c9d-560082869e36 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:16.522322 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276af89-d1a7-4264-8c9d-560082869e36 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:16.522601 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276af89-d1a7-4264-8c9d-560082869e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:16.541063 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-e276af89-d1a7-4264-8c9d-560082869e36 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:16.542262 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-e276af89-d1a7-4264-8c9d-560082869e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:16.550121 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1463/2897] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:16.554243 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2723f-a354-497b-8f8f-5ba6bfc1d339 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:16.563906 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2723f-a354-497b-8f8f-5ba6bfc1d339 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:16.569191 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6442f-2076-46f3-b3ff-31aa779f8b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:16.569871 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6442f-2076-46f3-b3ff-31aa779f8b3a admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:16.570179 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6442f-2076-46f3-b3ff-31aa779f8b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:16.570451 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6442f-2076-46f3-b3ff-31aa779f8b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:16.571168 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6442f-2076-46f3-b3ff-31aa779f8b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80116) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 06:17:16.571472 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6442f-2076-46f3-b3ff-31aa779f8b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:16.573105 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6442f-2076-46f3-b3ff-31aa779f8b3a admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:16.574662 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:16.588211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1435/2898] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jun 20 06:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 06:17:16.592550 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276af89-d1a7-4264-8c9d-560082869e36 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:16.601727 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276af89-d1a7-4264-8c9d-560082869e36 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:16.606399 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa575b-318b-474e-989f-4e33b68028b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:16.607037 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa575b-318b-474e-989f-4e33b68028b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:16.607321 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa575b-318b-474e-989f-4e33b68028b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:16.607600 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa575b-318b-474e-989f-4e33b68028b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:16.608339 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa575b-318b-474e-989f-4e33b68028b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:16.610269 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa575b-318b-474e-989f-4e33b68028b0 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:16.635466 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1464/2899] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jun 20 06:17:16 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:16.639794 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6442f-2076-46f3-b3ff-31aa779f8b3a admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:16.650195 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6442f-2076-46f3-b3ff-31aa779f8b3a admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:16.704525 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126aa706-f1f8-403d-b2ee-ff930a3fb892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:16.705186 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aa706-f1f8-403d-b2ee-ff930a3fb892 admin admin] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:16.705471 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aa706-f1f8-403d-b2ee-ff930a3fb892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:16.705748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aa706-f1f8-403d-b2ee-ff930a3fb892 admin admin] PATH_INFO: `/v3/users` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:16.706423 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126aa706-f1f8-403d-b2ee-ff930a3fb892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:16.708354 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126aa706-f1f8-403d-b2ee-ff930a3fb892 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:16.728821 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1436/2900] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jun 20 06:17:16 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 06:17:16.732889 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa575b-318b-474e-989f-4e33b68028b0 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:16.743103 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa575b-318b-474e-989f-4e33b68028b0 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:16.747752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5defa9-12e9-4e8e-be0f-244db95a8a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:16.748427 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5defa9-12e9-4e8e-be0f-244db95a8a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:16.748716 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5defa9-12e9-4e8e-be0f-244db95a8a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:16.748995 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5defa9-12e9-4e8e-be0f-244db95a8a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:16.749720 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5defa9-12e9-4e8e-be0f-244db95a8a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:16.751306 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5defa9-12e9-4e8e-be0f-244db95a8a30 admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:16.762115 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1465/2901] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:16.766142 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126aa706-f1f8-403d-b2ee-ff930a3fb892 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:16.776670 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126aa706-f1f8-403d-b2ee-ff930a3fb892 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:16.781316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e17ad-3a7a-4913-9901-aba78cb28eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:16.781968 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e17ad-3a7a-4913-9901-aba78cb28eac admin admin] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:16.782257 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e17ad-3a7a-4913-9901-aba78cb28eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:16.782536 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e17ad-3a7a-4913-9901-aba78cb28eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:16.783259 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e17ad-3a7a-4913-9901-aba78cb28eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:16.784887 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e17ad-3a7a-4913-9901-aba78cb28eac admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:16.794598 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1437/2902] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jun 20 06:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 06:17:16.798403 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5defa9-12e9-4e8e-be0f-244db95a8a30 admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:16.808222 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5defa9-12e9-4e8e-be0f-244db95a8a30 admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:16.812876 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234d809-d7a0-47fd-a99d-75d0d45c30cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:16.813739 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234d809-d7a0-47fd-a99d-75d0d45c30cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:16.814026 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234d809-d7a0-47fd-a99d-75d0d45c30cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:16.814303 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234d809-d7a0-47fd-a99d-75d0d45c30cf admin admin] PATH_INFO: `/v3/projects/db26d7abd02849f2a60236c2e040cab4/users/b6b2e561470a41e2be95376adab239b8/roles/9734fe47b63747daa9141041f1723e55` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:16.829044 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234d809-d7a0-47fd-a99d-75d0d45c30cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=db26d7abd02849f2a60236c2e040cab4, user_id=b6b2e561470a41e2be95376adab239b8, role_id=9734fe47b63747daa9141041f1723e55)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:16.831698 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234d809-d7a0-47fd-a99d-75d0d45c30cf admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:16.845191 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1466/2903] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jun 20 06:17:16 2022] PUT /identity/v3/projects/db26d7abd02849f2a60236c2e040cab4/users/b6b2e561470a41e2be95376adab239b8/roles/9734fe47b63747daa9141041f1723e55 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:16.856335 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e24d6-9064-4785-ab60-ae3cb979f1c1 None None] REQUEST_METHOD: `POST` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:16.856653 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e24d6-9064-4785-ab60-ae3cb979f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:16.856937 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e24d6-9064-4785-ab60-ae3cb979f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:16.883023 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.auth.core [None req-895e24d6-9064-4785-ab60-ae3cb979f1c1 None None] MFA Rules not processed for user `b6b2e561470a41e2be95376adab239b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80116) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:16.884231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-895e24d6-9064-4785-ab60-ae3cb979f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:16.947084 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1438/2904] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:16.958064 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234d809-d7a0-47fd-a99d-75d0d45c30cf admin admin] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:16.960398 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-a234d809-d7a0-47fd-a99d-75d0d45c30cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:17.016154 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234d809-d7a0-47fd-a99d-75d0d45c30cf admin admin] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:17.019837 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d049ba-d3e7-4b59-b2ee-814c986712aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e56cc5970ff645e594f50a0a204f44d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:17.020509 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d049ba-d3e7-4b59-b2ee-814c986712aa service cinder] REQUEST_METHOD: `GET` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:17.020799 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d049ba-d3e7-4b59-b2ee-814c986712aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:17.021606 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d049ba-d3e7-4b59-b2ee-814c986712aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:17.030119 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d049ba-d3e7-4b59-b2ee-814c986712aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:17.031558 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d049ba-d3e7-4b59-b2ee-814c986712aa service cinder] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:17.041182 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1467/2905] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:17.065281 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e24d6-9064-4785-ab60-ae3cb979f1c1 None None] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:17.126570 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e24d6-9064-4785-ab60-ae3cb979f1c1 None None] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:17.131231 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:17.132087 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:17.132401 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:17.132678 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] PATH_INFO: `/v3/users/b6b2e561470a41e2be95376adab239b8` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:17.133874 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b2e561470a41e2be95376adab239b8)` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:17.135799 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:17.138116 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:17.182244 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b2e561470a41e2be95376adab239b8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:17.182909 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b2e561470a41e2be95376adab239b8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:17.189692 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b2e561470a41e2be95376adab239b8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:17.196298 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b2e561470a41e2be95376adab239b8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:17.196971 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.notifications [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b2e561470a41e2be95376adab239b8'} {{(pid=80116) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:17.215064 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1439/2906] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jun 20 06:17:17 2022] DELETE /identity/v3/users/b6b2e561470a41e2be95376adab239b8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:17.219622 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3c9a-b34a-4803-94b9-79e3c7c37169 None None] REQUEST_METHOD: `POST` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:17.220019 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3c9a-b34a-4803-94b9-79e3c7c37169 None None] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:17.220433 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3c9a-b34a-4803-94b9-79e3c7c37169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:17.240897 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.auth.core [None req-befb3c9a-b34a-4803-94b9-79e3c7c37169 None None] MFA Rules not processed for user `97288f3cd6034b58b6dbfbe8f64b9614`. Rule list: `[]` (Enabled: `True`). {{(pid=80115) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 06:17:17.242160 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-befb3c9a-b34a-4803-94b9-79e3c7c37169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:17.250590 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:17.303864 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1468/2907] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jun 20 06:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 06:17:17.313339 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:17.314722 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:17.372947 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb902f-7851-4735-ab21-51d968248c01 admin admin] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:17.376709 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16827176-9efe-41f1-9bf8-651089aeff8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b46194590c47c08c8d9d98904a2d98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:17.377309 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827176-9efe-41f1-9bf8-651089aeff8f service neutron] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:17.377588 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827176-9efe-41f1-9bf8-651089aeff8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:17.377860 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827176-9efe-41f1-9bf8-651089aeff8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:17.387490 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16827176-9efe-41f1-9bf8-651089aeff8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:17.389217 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16827176-9efe-41f1-9bf8-651089aeff8f service neutron] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:17.399232 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1440/2908] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:17:17.663235 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3c9a-b34a-4803-94b9-79e3c7c37169 None None] Authenticating user token {{(pid=80115) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:17:17.664752 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.fernet_utils [None req-befb3c9a-b34a-4803-94b9-79e3c7c37169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80115) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:17:17.678831 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3c9a-b34a-4803-94b9-79e3c7c37169 None None] Validating token access rules against request {{(pid=80115) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:17:17.683779 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97288f3cd6034b58b6dbfbe8f64b9614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a570b43b29a48ed93337d06e7d2c924', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80115) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:17:17.684753 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:17:17.685035 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] SCRIPT_NAME: `/identity` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:17:17.685406 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] PATH_INFO: `/v3/projects/db26d7abd02849f2a60236c2e040cab4` {{(pid=80115) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:17:17.686605 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db26d7abd02849f2a60236c2e040cab4)` {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:17:17.688494 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] RBAC: Authorization granted {{(pid=80115) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:17:17.734220 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db26d7abd02849f2a60236c2e040cab4', 'request_id': 'req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:17.739585 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db26d7abd02849f2a60236c2e040cab4', 'request_id': 'req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:17.746136 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db26d7abd02849f2a60236c2e040cab4', 'request_id': 'req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e'} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:17.758291 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] The token cache is being invalidate because project db26d7abd02849f2a60236c2e040cab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80115) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 06:17:17.758577 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:17.759196 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG keystone.notifications [None req-2f189a76-a4ad-4c4f-aeb2-05f1219a786e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80115) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 06:17:17.760751 dv-cinder-836996-36-smb devstack@keystone.service[80115]: [pid: 80115|app: 0|req: 1469/2909] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jun 20 06:17:17 2022] DELETE /identity/v3/projects/db26d7abd02849f2a60236c2e040cab4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 06:17:27.394392 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:27.754674 dv-cinder-836996-36-smb devstack@keystone.service[80115]: DEBUG dbcounter [-] [80115] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80115) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:31.265922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16827176-9efe-41f1-9bf8-651089aeff8f service neutron] Authenticating user token {{(pid=80116) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 06:21:31.267316 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-16827176-9efe-41f1-9bf8-651089aeff8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:31.422040 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16827176-9efe-41f1-9bf8-651089aeff8f service neutron] Validating token access rules against request {{(pid=80116) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 06:21:31.479273 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c512f-c395-4735-963e-6f438f0a0a09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a5e0b53aafc4bf3a23a7882ed12a89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c9a952dddd450591b47adee04135d0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80116) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 06:21:31.479922 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c512f-c395-4735-963e-6f438f0a0a09 service placement] REQUEST_METHOD: `GET` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 06:21:31.480211 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c512f-c395-4735-963e-6f438f0a0a09 service placement] SCRIPT_NAME: `/identity` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 06:21:31.480583 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c512f-c395-4735-963e-6f438f0a0a09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80116) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 06:21:31.483748 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.fernet_utils [None req-9c0c512f-c395-4735-963e-6f438f0a0a09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80116) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 06:21:31.495093 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c512f-c395-4735-963e-6f438f0a0a09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 06:21:31.496750 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c512f-c395-4735-963e-6f438f0a0a09 service placement] RBAC: Authorization granted {{(pid=80116) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 06:21:31.507477 dv-cinder-836996-36-smb devstack@keystone.service[80116]: [pid: 80116|app: 0|req: 1441/2910] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jun 20 06:21:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 06:21:41.503255 dv-cinder-836996-36-smb devstack@keystone.service[80116]: DEBUG dbcounter [-] [80116] Writing DB stats keystone:SELECT=89 {{(pid=80116) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}